2023-07-24 07:06:25,042 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 07:06:25,305 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f 2023-07-24 07:06:25,305 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-24 07:06:25,351 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 07:06:25,612 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 07:06:25,613 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd, deleteOnExit=true 2023-07-24 07:06:25,613 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 07:06:25,614 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/test.cache.data in system properties and HBase conf 2023-07-24 07:06:25,614 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 07:06:25,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop.log.dir in system properties and HBase conf 2023-07-24 07:06:25,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 07:06:25,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 07:06:25,616 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 07:06:25,943 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 07:06:25,949 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 07:06:25,950 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 07:06:25,950 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 07:06:25,950 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 07:06:25,951 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 07:06:25,951 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 07:06:25,951 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 07:06:25,952 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 07:06:25,952 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 07:06:25,953 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/nfs.dump.dir in system properties and HBase conf 2023-07-24 07:06:25,953 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir in system properties and HBase conf 2023-07-24 07:06:25,954 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 07:06:25,954 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 07:06:25,955 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 07:06:26,578 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 07:06:26,582 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 07:06:26,863 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 07:06:27,025 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 07:06:27,040 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:27,087 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:27,126 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir/Jetty_localhost_39051_hdfs____mh7g40/webapp 2023-07-24 07:06:27,289 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39051 2023-07-24 07:06:27,336 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 07:06:27,336 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 07:06:27,907 WARN [Listener at localhost/42803] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 07:06:28,026 WARN [Listener at localhost/42803] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 07:06:28,047 WARN [Listener at localhost/42803] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:28,055 INFO [Listener at localhost/42803] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:28,063 INFO [Listener at localhost/42803] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir/Jetty_localhost_34981_datanode____.wfeeg8/webapp 2023-07-24 07:06:28,176 INFO [Listener at localhost/42803] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34981 2023-07-24 07:06:28,721 WARN [Listener at localhost/41221] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 07:06:28,763 WARN [Listener at localhost/41221] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 07:06:28,770 WARN [Listener at localhost/41221] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:28,773 INFO [Listener at localhost/41221] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:28,787 INFO [Listener at localhost/41221] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir/Jetty_localhost_34039_datanode____uajfng/webapp 2023-07-24 07:06:28,932 INFO [Listener at localhost/41221] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34039 2023-07-24 07:06:28,955 WARN [Listener at localhost/42435] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 07:06:28,991 WARN [Listener at localhost/42435] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 07:06:28,995 WARN [Listener at localhost/42435] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:28,996 INFO [Listener at localhost/42435] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:29,004 INFO [Listener at localhost/42435] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir/Jetty_localhost_37491_datanode____mb9zrj/webapp 2023-07-24 07:06:29,159 INFO [Listener at localhost/42435] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37491 2023-07-24 07:06:29,182 WARN [Listener at localhost/37839] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 07:06:29,470 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbd087ddfc2df7bb1: Processing first storage report for DS-66602e09-5426-49da-9645-cf84369d8102 from datanode 683bc870-44e9-4f8d-be09-f0367fbf953a 2023-07-24 07:06:29,472 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbd087ddfc2df7bb1: from storage DS-66602e09-5426-49da-9645-cf84369d8102 node DatanodeRegistration(127.0.0.1:46629, datanodeUuid=683bc870-44e9-4f8d-be09-f0367fbf953a, infoPort=35021, infoSecurePort=0, ipcPort=37839, storageInfo=lv=-57;cid=testClusterID;nsid=1749069381;c=1690182386651), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,473 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5b7d0aa9c40214e8: Processing first storage report for DS-038908ce-9845-414f-acd8-996e05595faa from datanode 9ca97a74-72fb-45a3-9209-59d147acef0c 2023-07-24 07:06:29,473 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5b7d0aa9c40214e8: from storage DS-038908ce-9845-414f-acd8-996e05595faa node DatanodeRegistration(127.0.0.1:34529, datanodeUuid=9ca97a74-72fb-45a3-9209-59d147acef0c, infoPort=35187, infoSecurePort=0, ipcPort=41221, storageInfo=lv=-57;cid=testClusterID;nsid=1749069381;c=1690182386651), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,473 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbd087ddfc2df7bb1: Processing first storage report for DS-44448f19-e531-4d05-a28b-ee512b8dce44 from datanode 683bc870-44e9-4f8d-be09-f0367fbf953a 2023-07-24 07:06:29,473 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbd087ddfc2df7bb1: from storage DS-44448f19-e531-4d05-a28b-ee512b8dce44 node DatanodeRegistration(127.0.0.1:46629, datanodeUuid=683bc870-44e9-4f8d-be09-f0367fbf953a, infoPort=35021, infoSecurePort=0, ipcPort=37839, storageInfo=lv=-57;cid=testClusterID;nsid=1749069381;c=1690182386651), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,474 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5b7d0aa9c40214e8: Processing first storage report for DS-ba40ba11-0173-4ee7-9179-9f71d2669ae6 from datanode 9ca97a74-72fb-45a3-9209-59d147acef0c 2023-07-24 07:06:29,474 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5b7d0aa9c40214e8: from storage DS-ba40ba11-0173-4ee7-9179-9f71d2669ae6 node DatanodeRegistration(127.0.0.1:34529, datanodeUuid=9ca97a74-72fb-45a3-9209-59d147acef0c, infoPort=35187, infoSecurePort=0, ipcPort=41221, storageInfo=lv=-57;cid=testClusterID;nsid=1749069381;c=1690182386651), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,474 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbb61823f04c12c50: Processing first storage report for DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7 from datanode 30503cfa-114b-4905-bc04-52bfa0d78188 2023-07-24 07:06:29,474 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbb61823f04c12c50: from storage DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7 node DatanodeRegistration(127.0.0.1:46483, datanodeUuid=30503cfa-114b-4905-bc04-52bfa0d78188, infoPort=40327, infoSecurePort=0, ipcPort=42435, storageInfo=lv=-57;cid=testClusterID;nsid=1749069381;c=1690182386651), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,474 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbb61823f04c12c50: Processing first storage report for DS-08cb3ff7-7b94-4b5b-b9cc-9b6b2d490976 from datanode 30503cfa-114b-4905-bc04-52bfa0d78188 2023-07-24 07:06:29,474 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbb61823f04c12c50: from storage DS-08cb3ff7-7b94-4b5b-b9cc-9b6b2d490976 node DatanodeRegistration(127.0.0.1:46483, datanodeUuid=30503cfa-114b-4905-bc04-52bfa0d78188, infoPort=40327, infoSecurePort=0, ipcPort=42435, storageInfo=lv=-57;cid=testClusterID;nsid=1749069381;c=1690182386651), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,712 DEBUG [Listener at localhost/37839] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f 2023-07-24 07:06:29,794 INFO [Listener at localhost/37839] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/zookeeper_0, clientPort=64453, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 07:06:29,814 INFO [Listener at localhost/37839] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64453 2023-07-24 07:06:29,824 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:29,827 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:30,549 INFO [Listener at localhost/37839] util.FSUtils(471): Created version file at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 with version=8 2023-07-24 07:06:30,549 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/hbase-staging 2023-07-24 07:06:30,938 INFO [Listener at localhost/37839] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 07:06:31,511 INFO [Listener at localhost/37839] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 07:06:31,550 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:31,550 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:31,551 INFO [Listener at localhost/37839] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 07:06:31,551 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:31,551 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 07:06:31,730 INFO [Listener at localhost/37839] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 07:06:31,825 DEBUG [Listener at localhost/37839] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 07:06:31,925 INFO [Listener at localhost/37839] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38165 2023-07-24 07:06:31,939 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:31,942 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:31,965 INFO [Listener at localhost/37839] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38165 connecting to ZooKeeper ensemble=127.0.0.1:64453 2023-07-24 07:06:32,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:381650x0, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 07:06:32,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38165-0x101962713120000 connected 2023-07-24 07:06:32,069 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:06:32,070 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:06:32,085 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 07:06:32,096 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38165 2023-07-24 07:06:32,096 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38165 2023-07-24 07:06:32,097 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38165 2023-07-24 07:06:32,097 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38165 2023-07-24 07:06:32,097 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38165 2023-07-24 07:06:32,105 INFO [Listener at localhost/37839] master.HMaster(444): hbase.rootdir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499, hbase.cluster.distributed=false 2023-07-24 07:06:32,180 INFO [Listener at localhost/37839] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 07:06:32,180 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,181 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,181 INFO [Listener at localhost/37839] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 07:06:32,181 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,181 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 07:06:32,188 INFO [Listener at localhost/37839] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 07:06:32,191 INFO [Listener at localhost/37839] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43589 2023-07-24 07:06:32,194 INFO [Listener at localhost/37839] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 07:06:32,202 DEBUG [Listener at localhost/37839] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 07:06:32,203 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,205 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,208 INFO [Listener at localhost/37839] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43589 connecting to ZooKeeper ensemble=127.0.0.1:64453 2023-07-24 07:06:32,214 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:435890x0, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 07:06:32,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43589-0x101962713120001 connected 2023-07-24 07:06:32,216 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:06:32,218 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:06:32,219 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 07:06:32,222 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43589 2023-07-24 07:06:32,225 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43589 2023-07-24 07:06:32,226 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43589 2023-07-24 07:06:32,228 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43589 2023-07-24 07:06:32,230 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43589 2023-07-24 07:06:32,249 INFO [Listener at localhost/37839] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 07:06:32,249 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,249 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,250 INFO [Listener at localhost/37839] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 07:06:32,250 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,251 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 07:06:32,251 INFO [Listener at localhost/37839] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 07:06:32,255 INFO [Listener at localhost/37839] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33211 2023-07-24 07:06:32,256 INFO [Listener at localhost/37839] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 07:06:32,258 DEBUG [Listener at localhost/37839] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 07:06:32,260 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,263 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,266 INFO [Listener at localhost/37839] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33211 connecting to ZooKeeper ensemble=127.0.0.1:64453 2023-07-24 07:06:32,279 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:332110x0, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 07:06:32,280 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:332110x0, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:06:32,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33211-0x101962713120002 connected 2023-07-24 07:06:32,282 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:06:32,283 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 07:06:32,287 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33211 2023-07-24 07:06:32,292 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33211 2023-07-24 07:06:32,293 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33211 2023-07-24 07:06:32,293 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33211 2023-07-24 07:06:32,294 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33211 2023-07-24 07:06:32,311 INFO [Listener at localhost/37839] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 07:06:32,311 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,312 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,312 INFO [Listener at localhost/37839] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 07:06:32,312 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,312 INFO [Listener at localhost/37839] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 07:06:32,312 INFO [Listener at localhost/37839] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 07:06:32,314 INFO [Listener at localhost/37839] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44253 2023-07-24 07:06:32,315 INFO [Listener at localhost/37839] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 07:06:32,320 DEBUG [Listener at localhost/37839] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 07:06:32,322 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,323 INFO [Listener at localhost/37839] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,325 INFO [Listener at localhost/37839] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44253 connecting to ZooKeeper ensemble=127.0.0.1:64453 2023-07-24 07:06:32,331 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:442530x0, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 07:06:32,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44253-0x101962713120003 connected 2023-07-24 07:06:32,333 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:06:32,334 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:06:32,335 DEBUG [Listener at localhost/37839] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 07:06:32,335 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44253 2023-07-24 07:06:32,336 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44253 2023-07-24 07:06:32,336 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44253 2023-07-24 07:06:32,337 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44253 2023-07-24 07:06:32,338 DEBUG [Listener at localhost/37839] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44253 2023-07-24 07:06:32,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:06:32,357 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 07:06:32,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:06:32,382 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 07:06:32,382 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 07:06:32,382 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 07:06:32,382 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 07:06:32,383 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:32,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 07:06:32,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38165,1690182390732 from backup master directory 2023-07-24 07:06:32,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 07:06:32,393 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:06:32,393 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 07:06:32,394 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 07:06:32,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:06:32,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 07:06:32,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 07:06:32,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/hbase.id with ID: ec926c27-4f5e-40f8-b74e-4efa29dc69df 2023-07-24 07:06:32,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,587 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:32,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3eeffd45 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:32,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2751884f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:32,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:32,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 07:06:32,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 07:06:32,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 07:06:32,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 07:06:32,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 07:06:32,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:32,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store-tmp 2023-07-24 07:06:32,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:32,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 07:06:32,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:06:32,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:06:32,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 07:06:32,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:06:32,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:06:32,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 07:06:32,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/WALs/jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:06:32,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38165%2C1690182390732, suffix=, logDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/WALs/jenkins-hbase4.apache.org,38165,1690182390732, archiveDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/oldWALs, maxLogs=10 2023-07-24 07:06:33,034 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK] 2023-07-24 07:06:33,034 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK] 2023-07-24 07:06:33,041 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK] 2023-07-24 07:06:33,047 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 07:06:33,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/WALs/jenkins-hbase4.apache.org,38165,1690182390732/jenkins-hbase4.apache.org%2C38165%2C1690182390732.1690182392964 2023-07-24 07:06:33,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK], DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK], DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK]] 2023-07-24 07:06:33,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:06:33,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:33,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,263 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 07:06:33,297 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 07:06:33,314 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:33,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:33,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67653663, jitterRate=0.00811813771724701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:33,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 07:06:33,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 07:06:33,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 07:06:33,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 07:06:33,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 07:06:33,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 07:06:33,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-24 07:06:33,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 07:06:33,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 07:06:33,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 07:06:33,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 07:06:33,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 07:06:33,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 07:06:33,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 07:06:33,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 07:06:33,525 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:33,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 07:06:33,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 07:06:33,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 07:06:33,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 07:06:33,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 07:06:33,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 07:06:33,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 07:06:33,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:33,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38165,1690182390732, sessionid=0x101962713120000, setting cluster-up flag (Was=false) 2023-07-24 07:06:33,575 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:33,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 07:06:33,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:06:33,589 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:33,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 07:06:33,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:06:33,600 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp 2023-07-24 07:06:33,648 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(951): ClusterId : ec926c27-4f5e-40f8-b74e-4efa29dc69df 2023-07-24 07:06:33,649 INFO [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(951): ClusterId : ec926c27-4f5e-40f8-b74e-4efa29dc69df 2023-07-24 07:06:33,656 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(951): ClusterId : ec926c27-4f5e-40f8-b74e-4efa29dc69df 2023-07-24 07:06:33,659 DEBUG [RS:1;jenkins-hbase4:33211] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 07:06:33,659 DEBUG [RS:2;jenkins-hbase4:44253] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 07:06:33,659 DEBUG [RS:0;jenkins-hbase4:43589] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 07:06:33,673 DEBUG [RS:1;jenkins-hbase4:33211] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 07:06:33,673 DEBUG [RS:1;jenkins-hbase4:33211] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 07:06:33,674 DEBUG [RS:0;jenkins-hbase4:43589] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 07:06:33,679 DEBUG [RS:0;jenkins-hbase4:43589] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 07:06:33,689 DEBUG [RS:1;jenkins-hbase4:33211] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 07:06:33,690 DEBUG [RS:2;jenkins-hbase4:44253] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 07:06:33,690 DEBUG [RS:2;jenkins-hbase4:44253] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 07:06:33,704 DEBUG [RS:1;jenkins-hbase4:33211] zookeeper.ReadOnlyZKClient(139): Connect 0x7f2e9774 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:33,706 DEBUG [RS:0;jenkins-hbase4:43589] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 07:06:33,707 DEBUG [RS:2;jenkins-hbase4:44253] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 07:06:33,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 07:06:33,716 DEBUG [RS:2;jenkins-hbase4:44253] zookeeper.ReadOnlyZKClient(139): Connect 0x54aba08c to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:33,723 DEBUG [RS:0;jenkins-hbase4:43589] zookeeper.ReadOnlyZKClient(139): Connect 0x62da0c26 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:33,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:33,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 07:06:33,753 DEBUG [RS:2;jenkins-hbase4:44253] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a6c4469, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:33,755 DEBUG [RS:2;jenkins-hbase4:44253] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e53cbfc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 07:06:33,788 DEBUG [RS:0;jenkins-hbase4:43589] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6733531c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:33,789 DEBUG [RS:1;jenkins-hbase4:33211] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d2439b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:33,789 DEBUG [RS:0;jenkins-hbase4:43589] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aac4477, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 07:06:33,789 DEBUG [RS:1;jenkins-hbase4:33211] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fbd7f59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 07:06:33,805 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33211 2023-07-24 07:06:33,809 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44253 2023-07-24 07:06:33,811 INFO [RS:2;jenkins-hbase4:44253] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 07:06:33,811 INFO [RS:2;jenkins-hbase4:44253] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 07:06:33,812 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 07:06:33,813 INFO [RS:1;jenkins-hbase4:33211] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 07:06:33,813 INFO [RS:1;jenkins-hbase4:33211] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 07:06:33,813 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 07:06:33,814 INFO [RS:1;jenkins-hbase4:33211] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:33,814 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 07:06:33,813 INFO [RS:2;jenkins-hbase4:44253] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:33,814 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 07:06:33,820 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38165,1690182390732 with isa=jenkins-hbase4.apache.org/172.31.14.131:44253, startcode=1690182392310 2023-07-24 07:06:33,820 INFO [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38165,1690182390732 with isa=jenkins-hbase4.apache.org/172.31.14.131:33211, startcode=1690182392248 2023-07-24 07:06:33,823 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43589 2023-07-24 07:06:33,823 INFO [RS:0;jenkins-hbase4:43589] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 07:06:33,824 INFO [RS:0;jenkins-hbase4:43589] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 07:06:33,824 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 07:06:33,824 INFO [RS:0;jenkins-hbase4:43589] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:33,824 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 07:06:33,825 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38165,1690182390732 with isa=jenkins-hbase4.apache.org/172.31.14.131:43589, startcode=1690182392179 2023-07-24 07:06:33,844 DEBUG [RS:2;jenkins-hbase4:44253] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 07:06:33,844 DEBUG [RS:1;jenkins-hbase4:33211] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 07:06:33,844 DEBUG [RS:0;jenkins-hbase4:43589] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 07:06:33,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 07:06:33,916 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43411, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 07:06:33,916 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48159, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 07:06:33,919 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54857, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 07:06:33,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 07:06:33,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 07:06:33,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 07:06:33,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 07:06:33,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 07:06:33,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:33,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 07:06:33,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:33,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690182423950 2023-07-24 07:06:33,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 07:06:33,953 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38165] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 07:06:33,962 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 07:06:33,963 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 07:06:33,967 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38165] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 07:06:33,970 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:33,970 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38165] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 07:06:33,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 07:06:33,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 07:06:33,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 07:06:33,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 07:06:33,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 07:06:33,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:33,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 07:06:33,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 07:06:33,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 07:06:33,995 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 07:06:33,996 WARN [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 07:06:33,996 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 07:06:33,996 WARN [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 07:06:34,004 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 07:06:34,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 07:06:34,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 07:06:34,008 WARN [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 07:06:34,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690182394011,5,FailOnTimeoutGroup] 2023-07-24 07:06:34,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690182394012,5,FailOnTimeoutGroup] 2023-07-24 07:06:34,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 07:06:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,049 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:34,051 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:34,051 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:06:34,093 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:34,098 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38165,1690182390732 with isa=jenkins-hbase4.apache.org/172.31.14.131:43589, startcode=1690182392179 2023-07-24 07:06:34,098 INFO [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38165,1690182390732 with isa=jenkins-hbase4.apache.org/172.31.14.131:33211, startcode=1690182392248 2023-07-24 07:06:34,096 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 07:06:34,102 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/info 2023-07-24 07:06:34,104 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 07:06:34,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,106 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38165] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:34,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 07:06:34,110 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/rep_barrier 2023-07-24 07:06:34,111 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 07:06:34,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,112 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38165,1690182390732 with isa=jenkins-hbase4.apache.org/172.31.14.131:44253, startcode=1690182392310 2023-07-24 07:06:34,113 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 07:06:34,114 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38165] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:34,115 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:06:34,115 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42803 2023-07-24 07:06:34,116 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 07:06:34,116 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38165] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,117 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:06:34,117 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42803 2023-07-24 07:06:34,117 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 07:06:34,119 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:06:34,119 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42803 2023-07-24 07:06:34,119 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 07:06:34,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/table 2023-07-24 07:06:34,120 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 07:06:34,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,124 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740 2023-07-24 07:06:34,125 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740 2023-07-24 07:06:34,127 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:06:34,128 DEBUG [RS:1;jenkins-hbase4:33211] zookeeper.ZKUtil(162): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:34,128 DEBUG [RS:2;jenkins-hbase4:44253] zookeeper.ZKUtil(162): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,129 WARN [RS:1;jenkins-hbase4:33211] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 07:06:34,130 INFO [RS:1;jenkins-hbase4:33211] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:34,130 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:34,131 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 07:06:34,131 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43589,1690182392179] 2023-07-24 07:06:34,131 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44253,1690182392310] 2023-07-24 07:06:34,131 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33211,1690182392248] 2023-07-24 07:06:34,130 WARN [RS:2;jenkins-hbase4:44253] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 07:06:34,133 INFO [RS:2;jenkins-hbase4:44253] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:34,133 DEBUG [RS:0;jenkins-hbase4:43589] zookeeper.ZKUtil(162): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:34,134 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,134 WARN [RS:0;jenkins-hbase4:43589] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 07:06:34,134 INFO [RS:0;jenkins-hbase4:43589] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:34,134 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:34,143 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 07:06:34,150 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:34,151 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73239508, jitterRate=0.09135371446609497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 07:06:34,151 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 07:06:34,151 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 07:06:34,151 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 07:06:34,151 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 07:06:34,151 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 07:06:34,151 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 07:06:34,152 DEBUG [RS:2;jenkins-hbase4:44253] zookeeper.ZKUtil(162): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:34,153 DEBUG [RS:1;jenkins-hbase4:33211] zookeeper.ZKUtil(162): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:34,152 DEBUG [RS:0;jenkins-hbase4:43589] zookeeper.ZKUtil(162): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:34,153 DEBUG [RS:2;jenkins-hbase4:44253] zookeeper.ZKUtil(162): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,153 DEBUG [RS:1;jenkins-hbase4:33211] zookeeper.ZKUtil(162): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,153 DEBUG [RS:0;jenkins-hbase4:43589] zookeeper.ZKUtil(162): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,154 DEBUG [RS:2;jenkins-hbase4:44253] zookeeper.ZKUtil(162): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:34,154 DEBUG [RS:0;jenkins-hbase4:43589] zookeeper.ZKUtil(162): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:34,155 DEBUG [RS:1;jenkins-hbase4:33211] zookeeper.ZKUtil(162): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:34,159 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 07:06:34,159 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 07:06:34,166 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 07:06:34,166 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 07:06:34,169 DEBUG [RS:1;jenkins-hbase4:33211] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 07:06:34,169 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 07:06:34,169 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 07:06:34,182 INFO [RS:2;jenkins-hbase4:44253] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 07:06:34,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 07:06:34,182 INFO [RS:1;jenkins-hbase4:33211] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 07:06:34,182 INFO [RS:0;jenkins-hbase4:43589] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 07:06:34,215 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 07:06:34,225 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 07:06:34,227 INFO [RS:0;jenkins-hbase4:43589] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 07:06:34,231 INFO [RS:1;jenkins-hbase4:33211] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 07:06:34,239 INFO [RS:2;jenkins-hbase4:44253] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 07:06:34,243 INFO [RS:1;jenkins-hbase4:33211] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 07:06:34,243 INFO [RS:2;jenkins-hbase4:44253] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 07:06:34,244 INFO [RS:1;jenkins-hbase4:33211] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,243 INFO [RS:0;jenkins-hbase4:43589] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 07:06:34,244 INFO [RS:0;jenkins-hbase4:43589] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,244 INFO [RS:2;jenkins-hbase4:44253] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,247 INFO [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 07:06:34,247 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 07:06:34,247 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 07:06:34,258 INFO [RS:0;jenkins-hbase4:43589] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,258 INFO [RS:1;jenkins-hbase4:33211] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,258 INFO [RS:2;jenkins-hbase4:44253] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,258 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,259 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,259 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,259 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,259 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,259 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,259 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,259 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,259 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,260 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,260 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 07:06:34,260 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 07:06:34,260 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,260 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,260 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,260 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,260 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,260 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,260 DEBUG [RS:2;jenkins-hbase4:44253] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,258 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,261 DEBUG [RS:0;jenkins-hbase4:43589] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,262 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,262 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,262 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,262 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,262 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 07:06:34,262 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,263 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,263 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,263 DEBUG [RS:1;jenkins-hbase4:33211] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,288 INFO [RS:1;jenkins-hbase4:33211] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,288 INFO [RS:1;jenkins-hbase4:33211] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,288 INFO [RS:1;jenkins-hbase4:33211] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,289 INFO [RS:0;jenkins-hbase4:43589] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,289 INFO [RS:0;jenkins-hbase4:43589] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,289 INFO [RS:0;jenkins-hbase4:43589] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,306 INFO [RS:2;jenkins-hbase4:44253] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,306 INFO [RS:2;jenkins-hbase4:44253] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,306 INFO [RS:2;jenkins-hbase4:44253] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,311 INFO [RS:1;jenkins-hbase4:33211] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 07:06:34,314 INFO [RS:1;jenkins-hbase4:33211] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33211,1690182392248-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,320 INFO [RS:0;jenkins-hbase4:43589] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 07:06:34,321 INFO [RS:0;jenkins-hbase4:43589] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43589,1690182392179-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,322 INFO [RS:2;jenkins-hbase4:44253] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 07:06:34,322 INFO [RS:2;jenkins-hbase4:44253] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44253,1690182392310-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,344 INFO [RS:0;jenkins-hbase4:43589] regionserver.Replication(203): jenkins-hbase4.apache.org,43589,1690182392179 started 2023-07-24 07:06:34,344 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43589,1690182392179, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43589, sessionid=0x101962713120001 2023-07-24 07:06:34,344 DEBUG [RS:0;jenkins-hbase4:43589] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 07:06:34,344 DEBUG [RS:0;jenkins-hbase4:43589] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:34,344 DEBUG [RS:0;jenkins-hbase4:43589] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43589,1690182392179' 2023-07-24 07:06:34,344 DEBUG [RS:0;jenkins-hbase4:43589] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 07:06:34,345 DEBUG [RS:0;jenkins-hbase4:43589] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 07:06:34,346 DEBUG [RS:0;jenkins-hbase4:43589] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 07:06:34,346 DEBUG [RS:0;jenkins-hbase4:43589] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 07:06:34,346 DEBUG [RS:0;jenkins-hbase4:43589] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:34,346 DEBUG [RS:0;jenkins-hbase4:43589] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43589,1690182392179' 2023-07-24 07:06:34,346 INFO [RS:2;jenkins-hbase4:44253] regionserver.Replication(203): jenkins-hbase4.apache.org,44253,1690182392310 started 2023-07-24 07:06:34,346 DEBUG [RS:0;jenkins-hbase4:43589] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:34,347 INFO [RS:1;jenkins-hbase4:33211] regionserver.Replication(203): jenkins-hbase4.apache.org,33211,1690182392248 started 2023-07-24 07:06:34,347 INFO [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33211,1690182392248, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33211, sessionid=0x101962713120002 2023-07-24 07:06:34,347 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44253,1690182392310, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44253, sessionid=0x101962713120003 2023-07-24 07:06:34,347 DEBUG [RS:1;jenkins-hbase4:33211] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 07:06:34,347 DEBUG [RS:0;jenkins-hbase4:43589] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:34,351 DEBUG [RS:2;jenkins-hbase4:44253] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 07:06:34,351 DEBUG [RS:2;jenkins-hbase4:44253] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,347 DEBUG [RS:1;jenkins-hbase4:33211] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:34,351 DEBUG [RS:2;jenkins-hbase4:44253] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44253,1690182392310' 2023-07-24 07:06:34,355 DEBUG [RS:2;jenkins-hbase4:44253] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 07:06:34,355 DEBUG [RS:1;jenkins-hbase4:33211] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33211,1690182392248' 2023-07-24 07:06:34,355 DEBUG [RS:1;jenkins-hbase4:33211] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 07:06:34,356 DEBUG [RS:0;jenkins-hbase4:43589] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 07:06:34,356 DEBUG [RS:1;jenkins-hbase4:33211] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 07:06:34,356 INFO [RS:0;jenkins-hbase4:43589] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 07:06:34,356 INFO [RS:0;jenkins-hbase4:43589] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 07:06:34,356 DEBUG [RS:2;jenkins-hbase4:44253] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 07:06:34,357 DEBUG [RS:1;jenkins-hbase4:33211] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 07:06:34,357 DEBUG [RS:1;jenkins-hbase4:33211] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 07:06:34,357 DEBUG [RS:1;jenkins-hbase4:33211] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:34,358 DEBUG [RS:1;jenkins-hbase4:33211] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33211,1690182392248' 2023-07-24 07:06:34,358 DEBUG [RS:1;jenkins-hbase4:33211] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:34,359 DEBUG [RS:2;jenkins-hbase4:44253] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 07:06:34,359 DEBUG [RS:2;jenkins-hbase4:44253] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 07:06:34,359 DEBUG [RS:2;jenkins-hbase4:44253] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,359 DEBUG [RS:2;jenkins-hbase4:44253] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44253,1690182392310' 2023-07-24 07:06:34,359 DEBUG [RS:2;jenkins-hbase4:44253] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:34,360 DEBUG [RS:1;jenkins-hbase4:33211] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:34,360 DEBUG [RS:2;jenkins-hbase4:44253] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:34,360 DEBUG [RS:1;jenkins-hbase4:33211] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 07:06:34,360 INFO [RS:1;jenkins-hbase4:33211] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 07:06:34,361 INFO [RS:1;jenkins-hbase4:33211] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 07:06:34,364 DEBUG [RS:2;jenkins-hbase4:44253] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 07:06:34,364 INFO [RS:2;jenkins-hbase4:44253] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 07:06:34,364 INFO [RS:2;jenkins-hbase4:44253] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 07:06:34,377 DEBUG [jenkins-hbase4:38165] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 07:06:34,382 DEBUG [jenkins-hbase4:38165] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:34,388 DEBUG [jenkins-hbase4:38165] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:34,388 DEBUG [jenkins-hbase4:38165] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:34,389 DEBUG [jenkins-hbase4:38165] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:34,389 DEBUG [jenkins-hbase4:38165] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:34,392 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44253,1690182392310, state=OPENING 2023-07-24 07:06:34,402 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 07:06:34,404 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:34,405 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 07:06:34,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:06:34,471 INFO [RS:2;jenkins-hbase4:44253] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44253%2C1690182392310, suffix=, logDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,44253,1690182392310, archiveDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/oldWALs, maxLogs=32 2023-07-24 07:06:34,473 INFO [RS:1;jenkins-hbase4:33211] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33211%2C1690182392248, suffix=, logDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,33211,1690182392248, archiveDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/oldWALs, maxLogs=32 2023-07-24 07:06:34,482 INFO [RS:0;jenkins-hbase4:43589] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43589%2C1690182392179, suffix=, logDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,43589,1690182392179, archiveDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/oldWALs, maxLogs=32 2023-07-24 07:06:34,515 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK] 2023-07-24 07:06:34,516 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK] 2023-07-24 07:06:34,517 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK] 2023-07-24 07:06:34,556 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK] 2023-07-24 07:06:34,556 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK] 2023-07-24 07:06:34,556 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK] 2023-07-24 07:06:34,580 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK] 2023-07-24 07:06:34,582 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK] 2023-07-24 07:06:34,583 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK] 2023-07-24 07:06:34,584 INFO [RS:1;jenkins-hbase4:33211] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,33211,1690182392248/jenkins-hbase4.apache.org%2C33211%2C1690182392248.1690182394476 2023-07-24 07:06:34,638 DEBUG [RS:1;jenkins-hbase4:33211] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK], DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK], DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK]] 2023-07-24 07:06:34,638 INFO [RS:2;jenkins-hbase4:44253] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,44253,1690182392310/jenkins-hbase4.apache.org%2C44253%2C1690182392310.1690182394479 2023-07-24 07:06:34,642 DEBUG [RS:2;jenkins-hbase4:44253] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK], DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK], DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK]] 2023-07-24 07:06:34,648 INFO [RS:0;jenkins-hbase4:43589] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,43589,1690182392179/jenkins-hbase4.apache.org%2C43589%2C1690182392179.1690182394483 2023-07-24 07:06:34,649 DEBUG [RS:0;jenkins-hbase4:43589] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK], DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK], DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK]] 2023-07-24 07:06:34,666 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:34,671 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:06:34,676 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:06:34,694 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 07:06:34,694 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:34,699 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44253%2C1690182392310.meta, suffix=.meta, logDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,44253,1690182392310, archiveDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/oldWALs, maxLogs=32 2023-07-24 07:06:34,730 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK] 2023-07-24 07:06:34,737 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK] 2023-07-24 07:06:34,737 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK] 2023-07-24 07:06:34,763 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/WALs/jenkins-hbase4.apache.org,44253,1690182392310/jenkins-hbase4.apache.org%2C44253%2C1690182392310.meta.1690182394701.meta 2023-07-24 07:06:34,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46483,DS-7f78b34e-0e64-49f0-a5d2-8fc79470e4b7,DISK], DatanodeInfoWithStorage[127.0.0.1:46629,DS-66602e09-5426-49da-9645-cf84369d8102,DISK], DatanodeInfoWithStorage[127.0.0.1:34529,DS-038908ce-9845-414f-acd8-996e05595faa,DISK]] 2023-07-24 07:06:34,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:06:34,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 07:06:34,770 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:34,771 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 07:06:34,773 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 07:06:34,774 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 07:06:34,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 07:06:34,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:34,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 07:06:34,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 07:06:34,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 07:06:34,802 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/info 2023-07-24 07:06:34,802 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/info 2023-07-24 07:06:34,803 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 07:06:34,804 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 07:06:34,807 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/rep_barrier 2023-07-24 07:06:34,807 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/rep_barrier 2023-07-24 07:06:34,808 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 07:06:34,809 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,809 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 07:06:34,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/table 2023-07-24 07:06:34,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/table 2023-07-24 07:06:34,815 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 07:06:34,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740 2023-07-24 07:06:34,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740 2023-07-24 07:06:34,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 07:06:34,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 07:06:34,836 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75179272, jitterRate=0.12025845050811768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 07:06:34,839 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 07:06:34,851 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690182394657 2023-07-24 07:06:34,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 07:06:34,884 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 07:06:34,886 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44253,1690182392310, state=OPEN 2023-07-24 07:06:34,891 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 07:06:34,891 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 07:06:34,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 07:06:34,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44253,1690182392310 in 482 msec 2023-07-24 07:06:34,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 07:06:34,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 718 msec 2023-07-24 07:06:34,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1600 sec 2023-07-24 07:06:34,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690182394919, completionTime=-1 2023-07-24 07:06:34,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 07:06:34,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 07:06:35,005 DEBUG [hconnection-0x5b72281d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:35,011 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:35,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 07:06:35,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690182455036 2023-07-24 07:06:35,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690182515036 2023-07-24 07:06:35,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 115 msec 2023-07-24 07:06:35,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38165,1690182390732-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38165,1690182390732-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38165,1690182390732-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38165, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,082 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 07:06:35,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 07:06:35,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:35,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 07:06:35,110 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:06:35,114 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:06:35,141 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,144 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d empty. 2023-07-24 07:06:35,145 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,145 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 07:06:35,241 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:35,255 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3bbb1ff0cbf023d434368f1d0dab797d, NAME => 'hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:06:35,309 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:35,310 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3bbb1ff0cbf023d434368f1d0dab797d, disabling compactions & flushes 2023-07-24 07:06:35,310 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:06:35,310 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:06:35,310 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. after waiting 0 ms 2023-07-24 07:06:35,310 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:06:35,310 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:06:35,310 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3bbb1ff0cbf023d434368f1d0dab797d: 2023-07-24 07:06:35,315 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:06:35,336 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690182395318"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182395318"}]},"ts":"1690182395318"} 2023-07-24 07:06:35,368 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 07:06:35,371 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:06:35,375 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182395371"}]},"ts":"1690182395371"} 2023-07-24 07:06:35,380 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 07:06:35,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:35,387 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:35,387 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:35,387 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:35,388 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:35,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3bbb1ff0cbf023d434368f1d0dab797d, ASSIGN}] 2023-07-24 07:06:35,395 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3bbb1ff0cbf023d434368f1d0dab797d, ASSIGN 2023-07-24 07:06:35,397 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3bbb1ff0cbf023d434368f1d0dab797d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44253,1690182392310; forceNewPlan=false, retain=false 2023-07-24 07:06:35,551 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 07:06:35,552 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3bbb1ff0cbf023d434368f1d0dab797d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:35,552 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690182395551"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182395551"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182395551"}]},"ts":"1690182395551"} 2023-07-24 07:06:35,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3bbb1ff0cbf023d434368f1d0dab797d, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:06:35,720 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:06:35,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3bbb1ff0cbf023d434368f1d0dab797d, NAME => 'hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d.', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:06:35,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. service=AccessControlService 2023-07-24 07:06:35,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:35,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:35,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,734 INFO [StoreOpener-3bbb1ff0cbf023d434368f1d0dab797d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,737 DEBUG [StoreOpener-3bbb1ff0cbf023d434368f1d0dab797d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d/info 2023-07-24 07:06:35,737 DEBUG [StoreOpener-3bbb1ff0cbf023d434368f1d0dab797d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d/info 2023-07-24 07:06:35,738 INFO [StoreOpener-3bbb1ff0cbf023d434368f1d0dab797d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bbb1ff0cbf023d434368f1d0dab797d columnFamilyName info 2023-07-24 07:06:35,738 INFO [StoreOpener-3bbb1ff0cbf023d434368f1d0dab797d-1] regionserver.HStore(310): Store=3bbb1ff0cbf023d434368f1d0dab797d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:35,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:06:35,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:35,753 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3bbb1ff0cbf023d434368f1d0dab797d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70575695, jitterRate=0.051659807562828064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:35,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3bbb1ff0cbf023d434368f1d0dab797d: 2023-07-24 07:06:35,759 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d., pid=6, masterSystemTime=1690182395711 2023-07-24 07:06:35,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:06:35,764 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:06:35,766 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3bbb1ff0cbf023d434368f1d0dab797d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:35,766 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690182395765"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182395765"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182395765"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182395765"}]},"ts":"1690182395765"} 2023-07-24 07:06:35,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 07:06:35,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3bbb1ff0cbf023d434368f1d0dab797d, server=jenkins-hbase4.apache.org,44253,1690182392310 in 216 msec 2023-07-24 07:06:35,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 07:06:35,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3bbb1ff0cbf023d434368f1d0dab797d, ASSIGN in 388 msec 2023-07-24 07:06:35,784 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:06:35,785 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182395784"}]},"ts":"1690182395784"} 2023-07-24 07:06:35,787 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 07:06:35,791 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:06:35,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 695 msec 2023-07-24 07:06:35,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 07:06:35,812 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 07:06:35,812 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:35,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 07:06:35,873 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 07:06:35,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-07-24 07:06:35,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 07:06:35,906 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 07:06:35,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 27 msec 2023-07-24 07:06:35,923 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 07:06:35,927 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 07:06:35,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.533sec 2023-07-24 07:06:35,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 07:06:35,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 07:06:35,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 07:06:35,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38165,1690182390732-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 07:06:35,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38165,1690182390732-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 07:06:35,964 DEBUG [Listener at localhost/37839] zookeeper.ReadOnlyZKClient(139): Connect 0x2d81a277 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:35,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:35,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 07:06:35,976 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:06:35,979 DEBUG [Listener at localhost/37839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f8c14a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:35,981 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:06:35,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 07:06:35,991 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:35,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 07:06:35,992 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e empty. 2023-07-24 07:06:35,995 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:35,996 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 07:06:36,006 DEBUG [hconnection-0x12de3cfe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:36,032 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:36,036 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:06:36,036 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 07:06:36,036 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/test.cache.data in system properties and HBase conf 2023-07-24 07:06:36,036 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 07:06:36,036 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop.log.dir in system properties and HBase conf 2023-07-24 07:06:36,036 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 07:06:36,037 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 07:06:36,037 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 07:06:36,037 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 07:06:36,037 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 07:06:36,037 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 07:06:36,037 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 07:06:36,038 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 07:06:36,038 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 07:06:36,038 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 07:06:36,038 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 07:06:36,038 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 07:06:36,038 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/nfs.dump.dir in system properties and HBase conf 2023-07-24 07:06:36,038 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir in system properties and HBase conf 2023-07-24 07:06:36,039 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 07:06:36,039 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 07:06:36,039 INFO [Listener at localhost/37839] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 07:06:36,076 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:36,078 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ad8203f24d6ca8146539c11ce1c01d2e, NAME => 'hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:06:36,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 07:06:36,145 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:36,146 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ad8203f24d6ca8146539c11ce1c01d2e, disabling compactions & flushes 2023-07-24 07:06:36,146 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:06:36,146 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:06:36,146 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. after waiting 0 ms 2023-07-24 07:06:36,146 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:06:36,146 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:06:36,146 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ad8203f24d6ca8146539c11ce1c01d2e: 2023-07-24 07:06:36,163 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:06:36,165 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690182396165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182396165"}]},"ts":"1690182396165"} 2023-07-24 07:06:36,169 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 07:06:36,174 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:06:36,175 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182396174"}]},"ts":"1690182396174"} 2023-07-24 07:06:36,180 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 07:06:36,187 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:36,188 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:36,188 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:36,188 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:36,189 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:36,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ad8203f24d6ca8146539c11ce1c01d2e, ASSIGN}] 2023-07-24 07:06:36,198 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ad8203f24d6ca8146539c11ce1c01d2e, ASSIGN 2023-07-24 07:06:36,201 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ad8203f24d6ca8146539c11ce1c01d2e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43589,1690182392179; forceNewPlan=false, retain=false 2023-07-24 07:06:36,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 07:06:36,351 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 07:06:36,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ad8203f24d6ca8146539c11ce1c01d2e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:36,353 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690182396352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182396352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182396352"}]},"ts":"1690182396352"} 2023-07-24 07:06:36,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ad8203f24d6ca8146539c11ce1c01d2e, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:06:36,512 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:36,512 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:06:36,516 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:06:36,523 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:06:36,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ad8203f24d6ca8146539c11ce1c01d2e, NAME => 'hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e.', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:06:36,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. service=AccessControlService 2023-07-24 07:06:36,524 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:36,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:36,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:36,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:36,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:36,527 INFO [StoreOpener-ad8203f24d6ca8146539c11ce1c01d2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:36,529 DEBUG [StoreOpener-ad8203f24d6ca8146539c11ce1c01d2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e/l 2023-07-24 07:06:36,529 DEBUG [StoreOpener-ad8203f24d6ca8146539c11ce1c01d2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e/l 2023-07-24 07:06:36,530 INFO [StoreOpener-ad8203f24d6ca8146539c11ce1c01d2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad8203f24d6ca8146539c11ce1c01d2e columnFamilyName l 2023-07-24 07:06:36,531 INFO [StoreOpener-ad8203f24d6ca8146539c11ce1c01d2e-1] regionserver.HStore(310): Store=ad8203f24d6ca8146539c11ce1c01d2e/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:36,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:36,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:36,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:06:36,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:36,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ad8203f24d6ca8146539c11ce1c01d2e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69378420, jitterRate=0.03381901979446411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:36,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ad8203f24d6ca8146539c11ce1c01d2e: 2023-07-24 07:06:36,550 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e., pid=11, masterSystemTime=1690182396511 2023-07-24 07:06:36,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:06:36,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:06:36,560 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ad8203f24d6ca8146539c11ce1c01d2e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:36,560 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690182396560"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182396560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182396560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182396560"}]},"ts":"1690182396560"} 2023-07-24 07:06:36,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 07:06:36,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ad8203f24d6ca8146539c11ce1c01d2e, server=jenkins-hbase4.apache.org,43589,1690182392179 in 207 msec 2023-07-24 07:06:36,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 07:06:36,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ad8203f24d6ca8146539c11ce1c01d2e, ASSIGN in 381 msec 2023-07-24 07:06:36,583 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:06:36,583 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182396583"}]},"ts":"1690182396583"} 2023-07-24 07:06:36,585 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 07:06:36,590 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:06:36,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 626 msec 2023-07-24 07:06:36,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 07:06:36,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 07:06:36,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 07:06:37,437 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:37,763 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:37,777 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40779_jobhistory____k7kjie/webapp 2023-07-24 07:06:37,959 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 07:06:37,959 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 07:06:37,959 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 07:06:37,962 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 07:06:38,046 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:38,346 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:38,657 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 07:06:38,714 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40779 2023-07-24 07:06:38,950 WARN [Listener at jenkins-hbase4.apache.org/37111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:39,409 WARN [Listener at jenkins-hbase4.apache.org/37111] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 07:06:39,410 INFO [Listener at jenkins-hbase4.apache.org/37111] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:39,426 INFO [Listener at jenkins-hbase4.apache.org/37111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42061_cluster____.a9rwo9/webapp 2023-07-24 07:06:39,515 INFO [Listener at jenkins-hbase4.apache.org/37111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 07:06:39,516 INFO [Listener at jenkins-hbase4.apache.org/37111] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 07:06:39,516 INFO [Listener at jenkins-hbase4.apache.org/37111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 07:06:39,516 INFO [Listener at jenkins-hbase4.apache.org/37111] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 07:06:39,529 INFO [Listener at jenkins-hbase4.apache.org/37111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:39,756 INFO [Listener at jenkins-hbase4.apache.org/37111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:39,955 INFO [Listener at jenkins-hbase4.apache.org/37111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:39,968 INFO [Listener at jenkins-hbase4.apache.org/37111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42061 2023-07-24 07:06:40,418 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:06:40,574 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 07:06:40,576 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 07:06:40,577 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 07:06:40,590 WARN [Listener at jenkins-hbase4.apache.org/41381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:40,635 WARN [Listener at jenkins-hbase4.apache.org/41381] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 07:06:40,635 INFO [Listener at jenkins-hbase4.apache.org/41381] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:40,642 INFO [Listener at jenkins-hbase4.apache.org/41381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33043_node____qghvnx/webapp 2023-07-24 07:06:40,700 INFO [Listener at jenkins-hbase4.apache.org/41381] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 07:06:40,700 INFO [Listener at jenkins-hbase4.apache.org/41381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 07:06:40,700 INFO [Listener at jenkins-hbase4.apache.org/41381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 07:06:40,701 INFO [Listener at jenkins-hbase4.apache.org/41381] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 07:06:40,708 INFO [Listener at jenkins-hbase4.apache.org/41381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:40,727 INFO [Listener at jenkins-hbase4.apache.org/41381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:40,827 INFO [Listener at jenkins-hbase4.apache.org/41381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:40,842 INFO [Listener at jenkins-hbase4.apache.org/41381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33043 2023-07-24 07:06:40,928 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:06:40,929 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 07:06:40,929 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:06:40,929 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 07:06:40,930 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 07:06:40,930 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 07:06:40,930 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:06:40,930 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 07:06:40,930 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 07:06:40,930 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 07:06:41,034 WARN [Listener at jenkins-hbase4.apache.org/46687] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:41,042 WARN [Listener at jenkins-hbase4.apache.org/46687] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 07:06:41,043 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:41,053 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39427_node____kf2f0x/webapp 2023-07-24 07:06:41,128 INFO [Listener at jenkins-hbase4.apache.org/46687] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 07:06:41,128 INFO [Listener at jenkins-hbase4.apache.org/46687] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 07:06:41,128 INFO [Listener at jenkins-hbase4.apache.org/46687] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 07:06:41,128 INFO [Listener at jenkins-hbase4.apache.org/46687] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 07:06:41,139 INFO [Listener at jenkins-hbase4.apache.org/46687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:41,158 INFO [Listener at jenkins-hbase4.apache.org/46687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:41,253 INFO [Listener at jenkins-hbase4.apache.org/46687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:41,280 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39427 2023-07-24 07:06:41,325 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 07:06:41,327 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:06:41,412 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=185, ProcessCount=173, AvailableMemoryMB=7900 2023-07-24 07:06:41,413 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-24 07:06:41,431 DEBUG [Listener at jenkins-hbase4.apache.org/46687] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 07:06:41,441 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 07:06:41,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:41,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:41,457 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:06:41,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 07:06:41,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:06:41,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:41,467 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:41,467 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:41,470 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450 empty. 2023-07-24 07:06:41,470 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b empty. 2023-07-24 07:06:41,471 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:41,471 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:41,472 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 07:06:41,509 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:41,511 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 86eeba0bb44a539d4d9725a9336d5450, NAME => 'testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:06:41,516 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4e300103d2eff3875ad7c33da178678b, NAME => 'testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:06:41,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:41,574 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:41,576 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 86eeba0bb44a539d4d9725a9336d5450, disabling compactions & flushes 2023-07-24 07:06:41,576 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:41,576 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:41,576 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. after waiting 0 ms 2023-07-24 07:06:41,576 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:41,576 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:41,576 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 86eeba0bb44a539d4d9725a9336d5450: 2023-07-24 07:06:41,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:41,976 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:41,976 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 4e300103d2eff3875ad7c33da178678b, disabling compactions & flushes 2023-07-24 07:06:41,976 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:41,976 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:41,976 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. after waiting 0 ms 2023-07-24 07:06:41,976 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:41,976 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:41,976 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 4e300103d2eff3875ad7c33da178678b: 2023-07-24 07:06:41,981 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:06:41,983 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182401983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182401983"}]},"ts":"1690182401983"} 2023-07-24 07:06:41,983 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182401983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182401983"}]},"ts":"1690182401983"} 2023-07-24 07:06:42,051 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:06:42,053 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:06:42,054 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182402054"}]},"ts":"1690182402054"} 2023-07-24 07:06:42,057 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 07:06:42,064 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:42,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:42,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:42,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:42,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:42,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=86eeba0bb44a539d4d9725a9336d5450, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4e300103d2eff3875ad7c33da178678b, ASSIGN}] 2023-07-24 07:06:42,073 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=86eeba0bb44a539d4d9725a9336d5450, ASSIGN 2023-07-24 07:06:42,074 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4e300103d2eff3875ad7c33da178678b, ASSIGN 2023-07-24 07:06:42,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:42,077 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=86eeba0bb44a539d4d9725a9336d5450, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33211,1690182392248; forceNewPlan=false, retain=false 2023-07-24 07:06:42,078 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4e300103d2eff3875ad7c33da178678b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43589,1690182392179; forceNewPlan=false, retain=false 2023-07-24 07:06:42,228 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:06:42,231 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=86eeba0bb44a539d4d9725a9336d5450, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,231 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4e300103d2eff3875ad7c33da178678b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,231 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182402231"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182402231"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182402231"}]},"ts":"1690182402231"} 2023-07-24 07:06:42,231 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182402231"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182402231"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182402231"}]},"ts":"1690182402231"} 2023-07-24 07:06:42,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 86eeba0bb44a539d4d9725a9336d5450, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:06:42,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 4e300103d2eff3875ad7c33da178678b, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:06:42,389 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,389 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:06:42,393 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:06:42,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:42,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 86eeba0bb44a539d4d9725a9336d5450, NAME => 'testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:06:42,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. service=AccessControlService 2023-07-24 07:06:42,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:42,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:42,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:42,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:42,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:42,407 INFO [StoreOpener-86eeba0bb44a539d4d9725a9336d5450-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:42,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:42,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e300103d2eff3875ad7c33da178678b, NAME => 'testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:06:42,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. service=AccessControlService 2023-07-24 07:06:42,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:42,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:42,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:42,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:42,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:42,410 DEBUG [StoreOpener-86eeba0bb44a539d4d9725a9336d5450-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf 2023-07-24 07:06:42,410 DEBUG [StoreOpener-86eeba0bb44a539d4d9725a9336d5450-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf 2023-07-24 07:06:42,410 INFO [StoreOpener-86eeba0bb44a539d4d9725a9336d5450-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86eeba0bb44a539d4d9725a9336d5450 columnFamilyName cf 2023-07-24 07:06:42,411 INFO [StoreOpener-4e300103d2eff3875ad7c33da178678b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:42,411 INFO [StoreOpener-86eeba0bb44a539d4d9725a9336d5450-1] regionserver.HStore(310): Store=86eeba0bb44a539d4d9725a9336d5450/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:42,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:42,414 DEBUG [StoreOpener-4e300103d2eff3875ad7c33da178678b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf 2023-07-24 07:06:42,414 DEBUG [StoreOpener-4e300103d2eff3875ad7c33da178678b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf 2023-07-24 07:06:42,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:42,414 INFO [StoreOpener-4e300103d2eff3875ad7c33da178678b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e300103d2eff3875ad7c33da178678b columnFamilyName cf 2023-07-24 07:06:42,416 INFO [StoreOpener-4e300103d2eff3875ad7c33da178678b-1] regionserver.HStore(310): Store=4e300103d2eff3875ad7c33da178678b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:42,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:42,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:42,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:42,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:42,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4e300103d2eff3875ad7c33da178678b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59261339, jitterRate=-0.11693723499774933}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:42,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4e300103d2eff3875ad7c33da178678b: 2023-07-24 07:06:42,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:42,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b., pid=16, masterSystemTime=1690182402392 2023-07-24 07:06:42,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:42,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:42,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:42,443 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4e300103d2eff3875ad7c33da178678b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,443 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182402442"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182402442"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182402442"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182402442"}]},"ts":"1690182402442"} 2023-07-24 07:06:42,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 86eeba0bb44a539d4d9725a9336d5450; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67056528, jitterRate=-7.798671722412109E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:42,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 86eeba0bb44a539d4d9725a9336d5450: 2023-07-24 07:06:42,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450., pid=15, masterSystemTime=1690182402389 2023-07-24 07:06:42,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:42,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:42,455 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=86eeba0bb44a539d4d9725a9336d5450, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,458 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182402455"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182402455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182402455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182402455"}]},"ts":"1690182402455"} 2023-07-24 07:06:42,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-24 07:06:42,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 4e300103d2eff3875ad7c33da178678b, server=jenkins-hbase4.apache.org,43589,1690182392179 in 214 msec 2023-07-24 07:06:42,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4e300103d2eff3875ad7c33da178678b, ASSIGN in 392 msec 2023-07-24 07:06:42,469 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-24 07:06:42,469 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 86eeba0bb44a539d4d9725a9336d5450, server=jenkins-hbase4.apache.org,33211,1690182392248 in 228 msec 2023-07-24 07:06:42,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 07:06:42,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=86eeba0bb44a539d4d9725a9336d5450, ASSIGN in 402 msec 2023-07-24 07:06:42,473 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:06:42,474 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182402473"}]},"ts":"1690182402473"} 2023-07-24 07:06:42,476 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 07:06:42,479 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:06:42,484 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 07:06:42,491 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:42,495 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:42,499 DEBUG [hconnection-0x189f47b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:42,503 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-24 07:06:42,513 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 07:06:42,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:42,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:42,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:42,553 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:42,554 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:42,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 07:06:42,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 07:06:42,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 07:06:42,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 07:06:42,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.1140 sec 2023-07-24 07:06:42,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:42,577 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 07:06:42,577 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-24 07:06:42,579 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:06:42,585 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-24 07:06:42,586 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:06:42,586 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-24 07:06:42,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:42,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182402607 (current time:1690182402607). 2023-07-24 07:06:42,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:06:42,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x5dd6a631 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:42,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69ca4c6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:42,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:42,621 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:42,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dd6a631 to 127.0.0.1:64453 2023-07-24 07:06:42,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:06:42,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x3c391016 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:42,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2843a302, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:42,729 DEBUG [hconnection-0x13fe9d23-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:42,733 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:42,740 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:42,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c391016 to 127.0.0.1:64453 2023-07-24 07:06:42,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:06:42,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 07:06:42,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:06:42,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:42,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:42,785 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:42,786 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690183002786 2023-07-24 07:06:42,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:42,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 07:06:42,789 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:42,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:42,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-24 07:06:42,792 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:42,793 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690183002793 2023-07-24 07:06:42,793 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:06:42,793 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:06:42,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,829 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 07:06:42,829 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:42,829 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 07:06:42,829 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 07:06:42,830 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,830 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,834 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:42,834 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:42,834 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:42,834 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:42,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:42,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:42,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:42,835 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,835 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,835 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,835 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:06:42,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 07:06:42,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 07:06:42,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 07:06:42,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:42,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:42,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:42,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,840 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:42,840 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:42,841 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:42,841 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:42,841 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:42,841 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:42,841 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:42,841 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:42,841 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:42,842 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:42,843 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:42,843 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:42,843 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:42,843 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:42,844 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:42,847 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,848 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:42,849 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,849 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:42,848 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:42,849 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,849 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:42,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:42,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:42,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:42,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 07:06:42,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@792c0672[Count = 1] remaining members to acquire global barrier 2023-07-24 07:06:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:42,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 07:06:42,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@792c0672[Count = 0] remaining members to acquire global barrier 2023-07-24 07:06:42,855 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 07:06:42,856 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:42,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:06:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:42,858 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,859 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:42,859 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,859 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:06:42,860 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:06:42,860 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:42,860 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:06:42,860 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. started... 2023-07-24 07:06:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:06:42,863 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:06:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:42,863 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. started... 2023-07-24 07:06:42,864 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:42,864 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:42,866 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86eeba0bb44a539d4d9725a9336d5450: 2023-07-24 07:06:42,866 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e300103d2eff3875ad7c33da178678b: 2023-07-24 07:06:42,867 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,867 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,873 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:06:42,873 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:06:42,877 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:06:42,877 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:06:42,894 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:42,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:42,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:42,900 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:06:42,920 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. completed. 2023-07-24 07:06:42,920 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:42,921 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. completed. 2023-07-24 07:06:42,921 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:42,921 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:06:42,921 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:06:42,921 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:06:42,921 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:06:42,921 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,921 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,922 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:42,922 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:42,922 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:06:42,922 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:06:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:42,928 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:42,930 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:42,930 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:42,930 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,930 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43589,1690182392179': 2023-07-24 07:06:42,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 07:06:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:06:42,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 07:06:42,940 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 07:06:42,940 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:06:42,940 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:06:42,940 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,940 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:06:42,944 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,944 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,944 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,944 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:42,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,944 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,944 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:42,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:42,944 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:42,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:42,945 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,947 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,947 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,950 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:42,950 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,950 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:42,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:42,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:42,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,966 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:42,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:42,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:42,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:42,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:42,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:42,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,970 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:42,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:42,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:42,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:42,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:42,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:42,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:42,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:43,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,100 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:43,100 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 07:06:43,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,102 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690182402787Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690182402967 (+180 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690182402968 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690182402986 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690182403014 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690182403100 (+86 ms) 2023-07-24 07:06:43,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:43,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:06:43,115 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:43,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 330 msec 2023-07-24 07:06:43,143 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,143 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,155 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33211] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:06:43,157 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43589] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:06:43,167 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 07:06:43,168 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:43,171 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:06:43,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:43,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182403206 (current time:1690182403206). 2023-07-24 07:06:43,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:06:43,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x051abd81 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:43,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@936ec54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:43,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,223 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x051abd81 to 127.0.0.1:64453 2023-07-24 07:06:43,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:06:43,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x0f88074c to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:43,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f2e4589, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:43,235 DEBUG [hconnection-0x61445674-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,237 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,244 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f88074c to 127.0.0.1:64453 2023-07-24 07:06:43,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:06:43,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 07:06:43,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:06:43,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:43,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:43,252 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:43,253 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690183003253 2023-07-24 07:06:43,253 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 07:06:43,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:43,255 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:06:43,255 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:06:43,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:43,256 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:43,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-24 07:06:43,260 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:43,261 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690183003261 2023-07-24 07:06:43,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 07:06:43,283 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 07:06:43,283 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:43,285 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 07:06:43,285 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 07:06:43,287 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,287 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,288 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,288 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,288 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,288 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,289 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,289 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,290 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,290 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:06:43,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 07:06:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 07:06:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 07:06:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:43,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:43,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 07:06:43,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 07:06:43,295 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:43,295 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 07:06:43,295 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:43,295 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:43,295 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:43,295 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:43,296 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:43,298 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:43,298 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:43,295 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:43,298 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:43,298 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:43,299 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:43,299 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:43,299 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:43,299 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:43,302 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,302 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,302 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,302 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,302 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,302 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,302 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:43,303 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,302 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,303 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:43,303 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:43,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 07:06:43,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eaf8100[Count = 1] remaining members to acquire global barrier 2023-07-24 07:06:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:43,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 07:06:43,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eaf8100[Count = 0] remaining members to acquire global barrier 2023-07-24 07:06:43,313 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 07:06:43,313 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:43,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,318 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:43,318 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:06:43,318 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:06:43,319 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,319 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:06:43,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,319 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:06:43,319 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,319 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:06:43,319 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. started... 2023-07-24 07:06:43,319 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. started... 2023-07-24 07:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:06:43,319 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 86eeba0bb44a539d4d9725a9336d5450 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 07:06:43,320 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4e300103d2eff3875ad7c33da178678b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 07:06:43,323 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:43,323 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:43,323 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:43,355 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:43,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:43,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:43,357 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:06:43,425 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/.tmp/cf/28222437a5734cb6a33d2542b3d30abe 2023-07-24 07:06:43,426 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/.tmp/cf/fed6817d8f614f4d8b2459f597f5b5fa 2023-07-24 07:06:43,477 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/.tmp/cf/fed6817d8f614f4d8b2459f597f5b5fa as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf/fed6817d8f614f4d8b2459f597f5b5fa 2023-07-24 07:06:43,477 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/.tmp/cf/28222437a5734cb6a33d2542b3d30abe as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf/28222437a5734cb6a33d2542b3d30abe 2023-07-24 07:06:43,487 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf/fed6817d8f614f4d8b2459f597f5b5fa, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 07:06:43,491 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf/28222437a5734cb6a33d2542b3d30abe, entries=47, sequenceid=6, filesize=8 K 2023-07-24 07:06:43,494 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 86eeba0bb44a539d4d9725a9336d5450 in 175ms, sequenceid=6, compaction requested=false 2023-07-24 07:06:43,494 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 07:06:43,495 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 4e300103d2eff3875ad7c33da178678b in 176ms, sequenceid=6, compaction requested=false 2023-07-24 07:06:43,496 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86eeba0bb44a539d4d9725a9336d5450: 2023-07-24 07:06:43,496 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e300103d2eff3875ad7c33da178678b: 2023-07-24 07:06:43,496 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:43,496 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:43,497 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:06:43,497 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:06:43,497 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf/fed6817d8f614f4d8b2459f597f5b5fa] hfiles 2023-07-24 07:06:43,497 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf/28222437a5734cb6a33d2542b3d30abe] hfiles 2023-07-24 07:06:43,497 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf/fed6817d8f614f4d8b2459f597f5b5fa for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:43,497 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf/28222437a5734cb6a33d2542b3d30abe for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:43,521 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. completed. 2023-07-24 07:06:43,522 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:43,522 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:06:43,522 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:06:43,522 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,522 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:43,522 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:06:43,522 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. completed. 2023-07-24 07:06:43,523 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:43,523 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:06:43,523 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:06:43,523 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,523 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:43,523 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:06:43,525 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:43,525 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,525 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:43,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,525 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:43,526 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:43,527 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,527 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:43,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,527 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:43,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:06:43,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 07:06:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:43,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43589,1690182392179': 2023-07-24 07:06:43,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 07:06:43,537 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 07:06:43,537 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:06:43,537 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:06:43,537 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 07:06:43,537 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:06:43,540 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,540 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,540 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:43,540 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,540 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,540 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,541 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:43,541 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:43,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:43,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:43,542 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,542 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,545 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:43,545 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,546 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,558 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,559 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,560 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:43,560 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 07:06:43,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 07:06:43,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:43,560 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:43,560 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:43,560 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:43,560 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:43,561 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:43,561 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,561 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:43,561 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:06:43,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 07:06:43,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,696 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 07:06:43,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690182403253Consolidate snapshot: snaptb0-testExportWithTargetName at 1690182403560 (+307 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690182403560Writing data manifest for snaptb0-testExportWithTargetName at 1690182403575 (+15 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690182403599 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690182403695 (+96 ms) 2023-07-24 07:06:43,699 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:43,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 445 msec 2023-07-24 07:06:43,861 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:43,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:43,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:06:43,865 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865 2023-07-24 07:06:43,865 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42803, tgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865, rawTgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865, srcFsUri=hdfs://localhost:42803, srcDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:06:43,918 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:06:43,918 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1426800605_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 07:06:43,919 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499, snapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 07:06:43,940 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 07:06:44,037 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,038 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,039 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,040 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,040 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,041 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,041 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,130 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop-6908086173919375517.jar 2023-07-24 07:06:44,131 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,132 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,132 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,132 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,133 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,133 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:44,134 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:06:44,135 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:06:44,135 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:06:44,136 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:06:44,136 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:06:44,137 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:06:44,137 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:06:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:06:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:06:44,139 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:06:44,144 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:06:44,144 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:06:44,145 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:06:44,145 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:06:44,145 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:06:44,146 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:06:44,146 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:06:45,144 WARN [Listener at jenkins-hbase4.apache.org/46687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:06:45,149 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 07:06:45,158 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 07:06:45,590 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:06:45,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:06:46,106 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0001_000001 (auth:SIMPLE) 2023-07-24 07:06:47,915 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:06:51,263 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0001_000001 (auth:SIMPLE) 2023-07-24 07:06:53,600 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0001_000001 (auth:SIMPLE) 2023-07-24 07:06:57,145 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0001_000001 (auth:SIMPLE) 2023-07-24 07:06:59,041 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:06:59,046 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:06:59,062 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 07:06:59,062 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:06:59,063 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:06:59,063 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 07:06:59,063 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 07:06:59,064 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 07:06:59,064 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865/.hbase-snapshot/testExportWithTargetName 2023-07-24 07:06:59,070 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 07:06:59,070 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182403865/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 07:06:59,095 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 07:06:59,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 07:06:59,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:59,117 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182419117"}]},"ts":"1690182419117"} 2023-07-24 07:06:59,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 07:06:59,119 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 07:06:59,121 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 07:06:59,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=86eeba0bb44a539d4d9725a9336d5450, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4e300103d2eff3875ad7c33da178678b, UNASSIGN}] 2023-07-24 07:06:59,126 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=86eeba0bb44a539d4d9725a9336d5450, UNASSIGN 2023-07-24 07:06:59,126 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4e300103d2eff3875ad7c33da178678b, UNASSIGN 2023-07-24 07:06:59,127 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4e300103d2eff3875ad7c33da178678b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:59,127 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182419127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182419127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182419127"}]},"ts":"1690182419127"} 2023-07-24 07:06:59,128 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=86eeba0bb44a539d4d9725a9336d5450, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:06:59,128 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182419127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182419127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182419127"}]},"ts":"1690182419127"} 2023-07-24 07:06:59,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 4e300103d2eff3875ad7c33da178678b, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:06:59,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 86eeba0bb44a539d4d9725a9336d5450, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:06:59,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 07:06:59,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:59,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 86eeba0bb44a539d4d9725a9336d5450, disabling compactions & flushes 2023-07-24 07:06:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4e300103d2eff3875ad7c33da178678b, disabling compactions & flushes 2023-07-24 07:06:59,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:59,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. after waiting 0 ms 2023-07-24 07:06:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. after waiting 0 ms 2023-07-24 07:06:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:59,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:06:59,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:06:59,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:06:59,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:06:59,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450. 2023-07-24 07:06:59,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b. 2023-07-24 07:06:59,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 86eeba0bb44a539d4d9725a9336d5450: 2023-07-24 07:06:59,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4e300103d2eff3875ad7c33da178678b: 2023-07-24 07:06:59,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:59,319 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4e300103d2eff3875ad7c33da178678b, regionState=CLOSED 2023-07-24 07:06:59,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:59,319 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182419319"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182419319"}]},"ts":"1690182419319"} 2023-07-24 07:06:59,320 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=86eeba0bb44a539d4d9725a9336d5450, regionState=CLOSED 2023-07-24 07:06:59,320 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182419320"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182419320"}]},"ts":"1690182419320"} 2023-07-24 07:06:59,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-24 07:06:59,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 4e300103d2eff3875ad7c33da178678b, server=jenkins-hbase4.apache.org,43589,1690182392179 in 191 msec 2023-07-24 07:06:59,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-24 07:06:59,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 86eeba0bb44a539d4d9725a9336d5450, server=jenkins-hbase4.apache.org,33211,1690182392248 in 187 msec 2023-07-24 07:06:59,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4e300103d2eff3875ad7c33da178678b, UNASSIGN in 201 msec 2023-07-24 07:06:59,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-24 07:06:59,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=86eeba0bb44a539d4d9725a9336d5450, UNASSIGN in 202 msec 2023-07-24 07:06:59,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182419331"}]},"ts":"1690182419331"} 2023-07-24 07:06:59,333 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 07:06:59,335 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 07:06:59,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 231 msec 2023-07-24 07:06:59,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 07:06:59,421 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 07:06:59,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 07:06:59,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:59,437 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:59,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 07:06:59,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:59,443 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 07:06:59,446 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:59,446 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:59,447 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 07:06:59,447 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 07:06:59,447 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 07:06:59,447 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 07:06:59,449 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:59,449 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:59,449 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:59,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 07:06:59,449 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:06:59,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 07:06:59,449 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:59,450 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:06:59,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 07:06:59,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 07:06:59,450 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:06:59,450 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:06:59,451 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/recovered.edits] 2023-07-24 07:06:59,451 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/recovered.edits] 2023-07-24 07:06:59,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 07:06:59,459 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf/fed6817d8f614f4d8b2459f597f5b5fa to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/cf/fed6817d8f614f4d8b2459f597f5b5fa 2023-07-24 07:06:59,460 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf/28222437a5734cb6a33d2542b3d30abe to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/cf/28222437a5734cb6a33d2542b3d30abe 2023-07-24 07:06:59,464 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450/recovered.edits/9.seqid 2023-07-24 07:06:59,464 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b/recovered.edits/9.seqid 2023-07-24 07:06:59,465 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/86eeba0bb44a539d4d9725a9336d5450 2023-07-24 07:06:59,466 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportWithTargetName/4e300103d2eff3875ad7c33da178678b 2023-07-24 07:06:59,466 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 07:06:59,470 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:59,498 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 07:06:59,502 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 07:06:59,505 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:59,506 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 07:06:59,506 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182419506"}]},"ts":"9223372036854775807"} 2023-07-24 07:06:59,506 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182419506"}]},"ts":"9223372036854775807"} 2023-07-24 07:06:59,509 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:06:59,509 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 86eeba0bb44a539d4d9725a9336d5450, NAME => 'testtb-testExportWithTargetName,,1690182401450.86eeba0bb44a539d4d9725a9336d5450.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4e300103d2eff3875ad7c33da178678b, NAME => 'testtb-testExportWithTargetName,1,1690182401450.4e300103d2eff3875ad7c33da178678b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:06:59,510 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 07:06:59,510 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182419510"}]},"ts":"9223372036854775807"} 2023-07-24 07:06:59,520 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 07:06:59,523 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:59,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 95 msec 2023-07-24 07:06:59,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 07:06:59,556 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 07:06:59,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 07:06:59,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:59,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 07:06:59,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 07:06:59,636 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=759 (was 707) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189602831_1 at /127.0.0.1:54406 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1278 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:37785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:53970 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:58420 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:45693 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_189602831_1 at /127.0.0.1:53952 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:54430 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:46687 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=934 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 185) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=5878 (was 7900) 2023-07-24 07:06:59,636 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-24 07:06:59,664 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=759, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=249, ProcessCount=182, AvailableMemoryMB=5832 2023-07-24 07:06:59,665 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-24 07:06:59,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:59,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:06:59,673 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:06:59,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 07:06:59,675 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:06:59,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 07:06:59,678 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300 2023-07-24 07:06:59,679 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:06:59,679 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935 empty. 2023-07-24 07:06:59,679 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300 empty. 2023-07-24 07:06:59,680 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:06:59,680 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300 2023-07-24 07:06:59,680 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 07:06:59,695 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:59,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9045717d7bb44adef8a979edf3f98300, NAME => 'testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:06:59,697 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c2e4ae4c97e79dc1d0c88e56b91a1935, NAME => 'testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:06:59,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:59,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9045717d7bb44adef8a979edf3f98300, disabling compactions & flushes 2023-07-24 07:06:59,745 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:06:59,745 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:06:59,745 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. after waiting 0 ms 2023-07-24 07:06:59,745 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:06:59,745 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:06:59,745 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9045717d7bb44adef8a979edf3f98300: 2023-07-24 07:06:59,748 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:59,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c2e4ae4c97e79dc1d0c88e56b91a1935, disabling compactions & flushes 2023-07-24 07:06:59,750 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:06:59,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:06:59,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. after waiting 0 ms 2023-07-24 07:06:59,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:06:59,750 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:06:59,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c2e4ae4c97e79dc1d0c88e56b91a1935: 2023-07-24 07:06:59,757 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:06:59,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182419758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182419758"}]},"ts":"1690182419758"} 2023-07-24 07:06:59,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182419758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182419758"}]},"ts":"1690182419758"} 2023-07-24 07:06:59,766 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:06:59,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:06:59,768 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182419768"}]},"ts":"1690182419768"} 2023-07-24 07:06:59,771 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 07:06:59,776 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:59,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 07:06:59,777 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:59,777 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:59,777 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:59,777 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:59,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9045717d7bb44adef8a979edf3f98300, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2e4ae4c97e79dc1d0c88e56b91a1935, ASSIGN}] 2023-07-24 07:06:59,782 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9045717d7bb44adef8a979edf3f98300, ASSIGN 2023-07-24 07:06:59,782 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2e4ae4c97e79dc1d0c88e56b91a1935, ASSIGN 2023-07-24 07:06:59,783 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9045717d7bb44adef8a979edf3f98300, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43589,1690182392179; forceNewPlan=false, retain=false 2023-07-24 07:06:59,783 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2e4ae4c97e79dc1d0c88e56b91a1935, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44253,1690182392310; forceNewPlan=false, retain=false 2023-07-24 07:06:59,934 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:06:59,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9045717d7bb44adef8a979edf3f98300, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:06:59,937 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c2e4ae4c97e79dc1d0c88e56b91a1935, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:06:59,937 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182419937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182419937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182419937"}]},"ts":"1690182419937"} 2023-07-24 07:06:59,937 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182419937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182419937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182419937"}]},"ts":"1690182419937"} 2023-07-24 07:06:59,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 9045717d7bb44adef8a979edf3f98300, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:06:59,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure c2e4ae4c97e79dc1d0c88e56b91a1935, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:06:59,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 07:07:00,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:00,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9045717d7bb44adef8a979edf3f98300, NAME => 'testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:07:00,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. service=AccessControlService 2023-07-24 07:07:00,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:00,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:00,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:00,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:00,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:00,104 INFO [StoreOpener-9045717d7bb44adef8a979edf3f98300-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:00,107 DEBUG [StoreOpener-9045717d7bb44adef8a979edf3f98300-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf 2023-07-24 07:07:00,107 DEBUG [StoreOpener-9045717d7bb44adef8a979edf3f98300-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf 2023-07-24 07:07:00,108 INFO [StoreOpener-9045717d7bb44adef8a979edf3f98300-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9045717d7bb44adef8a979edf3f98300 columnFamilyName cf 2023-07-24 07:07:00,109 INFO [StoreOpener-9045717d7bb44adef8a979edf3f98300-1] regionserver.HStore(310): Store=9045717d7bb44adef8a979edf3f98300/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:00,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:00,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2e4ae4c97e79dc1d0c88e56b91a1935, NAME => 'testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:07:00,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:00,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. service=AccessControlService 2023-07-24 07:07:00,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:00,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:00,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:00,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:00,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:00,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:00,114 INFO [StoreOpener-c2e4ae4c97e79dc1d0c88e56b91a1935-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:00,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:00,116 DEBUG [StoreOpener-c2e4ae4c97e79dc1d0c88e56b91a1935-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf 2023-07-24 07:07:00,116 DEBUG [StoreOpener-c2e4ae4c97e79dc1d0c88e56b91a1935-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf 2023-07-24 07:07:00,117 INFO [StoreOpener-c2e4ae4c97e79dc1d0c88e56b91a1935-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2e4ae4c97e79dc1d0c88e56b91a1935 columnFamilyName cf 2023-07-24 07:07:00,118 INFO [StoreOpener-c2e4ae4c97e79dc1d0c88e56b91a1935-1] regionserver.HStore(310): Store=c2e4ae4c97e79dc1d0c88e56b91a1935/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:00,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:00,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:00,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:00,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9045717d7bb44adef8a979edf3f98300; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67918216, jitterRate=0.012060284614562988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:00,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9045717d7bb44adef8a979edf3f98300: 2023-07-24 07:07:00,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300., pid=30, masterSystemTime=1690182420092 2023-07-24 07:07:00,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:00,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:00,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:00,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9045717d7bb44adef8a979edf3f98300, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,130 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182420130"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182420130"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182420130"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182420130"}]},"ts":"1690182420130"} 2023-07-24 07:07:00,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:00,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2e4ae4c97e79dc1d0c88e56b91a1935; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68219822, jitterRate=0.016554564237594604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:00,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2e4ae4c97e79dc1d0c88e56b91a1935: 2023-07-24 07:07:00,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935., pid=31, masterSystemTime=1690182420093 2023-07-24 07:07:00,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-24 07:07:00,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 9045717d7bb44adef8a979edf3f98300, server=jenkins-hbase4.apache.org,43589,1690182392179 in 193 msec 2023-07-24 07:07:00,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c2e4ae4c97e79dc1d0c88e56b91a1935, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:00,150 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182420149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182420149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182420149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182420149"}]},"ts":"1690182420149"} 2023-07-24 07:07:00,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:00,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9045717d7bb44adef8a979edf3f98300, ASSIGN in 366 msec 2023-07-24 07:07:00,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-24 07:07:00,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure c2e4ae4c97e79dc1d0c88e56b91a1935, server=jenkins-hbase4.apache.org,44253,1690182392310 in 214 msec 2023-07-24 07:07:00,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-24 07:07:00,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2e4ae4c97e79dc1d0c88e56b91a1935, ASSIGN in 381 msec 2023-07-24 07:07:00,164 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:07:00,165 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182420164"}]},"ts":"1690182420164"} 2023-07-24 07:07:00,166 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 07:07:00,171 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:07:00,171 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 07:07:00,174 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:07:00,176 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:00,176 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:00,176 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:00,176 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:00,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:00,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:00,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:00,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:00,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 511 msec 2023-07-24 07:07:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 07:07:00,284 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 07:07:00,285 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 07:07:00,285 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:00,294 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 07:07:00,294 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:00,295 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-24 07:07:00,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:00,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182420299 (current time:1690182420299). 2023-07-24 07:07:00,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:00,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x6397104d to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:00,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12742ee4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:00,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:00,316 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:00,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6397104d to 127.0.0.1:64453 2023-07-24 07:07:00,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:00,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x790d59f2 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:00,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22432be6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:00,335 DEBUG [hconnection-0x11733244-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:00,336 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:00,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:00,344 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:00,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x790d59f2 to 127.0.0.1:64453 2023-07-24 07:07:00,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:00,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:07:00,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:00,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:00,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:00,353 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:00,355 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690183020355 2023-07-24 07:07:00,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:00,355 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 07:07:00,356 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:00,356 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:00,361 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:00,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:00,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-24 07:07:00,366 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:00,369 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690183020369 2023-07-24 07:07:00,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,411 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 07:07:00,411 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:00,413 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 07:07:00,413 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 07:07:00,453 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,453 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,454 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,454 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,454 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,454 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,455 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,455 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,456 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,456 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,456 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 07:07:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 07:07:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,457 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:00,457 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:00,457 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 07:07:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:07:00,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:00,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:00,459 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:00,459 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:00,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,459 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:00,459 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:00,459 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:00,459 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:00,459 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:00,461 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:00,461 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:00,461 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:00,459 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:00,462 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:00,462 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:00,462 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:00,468 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,468 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,468 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,468 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,469 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,469 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,469 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,469 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:00,469 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:00,469 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,470 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 07:07:00,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3737285b[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:00,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 07:07:00,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3737285b[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:00,474 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 07:07:00,474 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,475 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,476 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,476 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,476 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,476 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:00,476 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:00,476 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:07:00,476 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,476 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:00,476 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,476 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:00,476 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:00,477 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:00,477 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:00,477 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. started... 2023-07-24 07:07:00,477 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:00,477 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:00,477 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:00,477 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. started... 2023-07-24 07:07:00,478 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2e4ae4c97e79dc1d0c88e56b91a1935: 2023-07-24 07:07:00,479 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9045717d7bb44adef8a979edf3f98300: 2023-07-24 07:07:00,480 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,480 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:00,480 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:00,480 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,480 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:00,480 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:00,480 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:00,480 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:00,480 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:00,503 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. completed. 2023-07-24 07:07:00,503 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:00,503 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:00,503 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:00,503 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,503 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:00,503 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:07:00,505 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,505 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:00,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,505 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:00,506 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:00,507 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. completed. 2023-07-24 07:07:00,507 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:00,507 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:00,508 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:00,508 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,508 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:00,508 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,509 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,509 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,509 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:00,509 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:00,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43589,1690182392179': 2023-07-24 07:07:00,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 07:07:00,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44253,1690182392310': 2023-07-24 07:07:00,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 07:07:00,518 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 07:07:00,518 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:00,518 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:00,518 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,518 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:00,520 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,520 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,520 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,520 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,521 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,522 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,524 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,524 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,525 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,530 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,530 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,533 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,533 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,533 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,533 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,533 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,588 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 07:07:00,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,588 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:00,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690182420356Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690182420530 (+174 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690182420530Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690182420537 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690182420555 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690182420588 (+33 ms) 2023-07-24 07:07:00,592 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:00,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 233 msec 2023-07-24 07:07:00,659 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:00,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:07:00,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:00,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43589] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:00,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44253] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:00,678 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 07:07:00,678 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:00,680 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:00,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:00,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182420693 (current time:1690182420693). 2023-07-24 07:07:00,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:00,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x2c6851d2 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:00,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d6b9e9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:00,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:00,703 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:00,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c6851d2 to 127.0.0.1:64453 2023-07-24 07:07:00,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:00,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x1eef5019 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:00,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31398322, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:00,714 DEBUG [hconnection-0x39c92429-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:00,717 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:00,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:00,723 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:00,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1eef5019 to 127.0.0.1:64453 2023-07-24 07:07:00,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:00,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:07:00,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:00,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:00,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:00,729 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:00,730 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690183020730 2023-07-24 07:07:00,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:00,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 07:07:00,731 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:00,731 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:00,733 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:00,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:00,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 07:07:00,735 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:00,736 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690183020736 2023-07-24 07:07:00,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 07:07:00,750 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 07:07:00,750 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:00,751 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 07:07:00,751 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 07:07:00,752 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,752 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,753 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,753 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,753 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,753 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,753 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,753 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,754 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,754 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 07:07:00,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:00,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:00,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:00,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 07:07:00,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 07:07:00,755 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:00,755 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:00,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 07:07:00,755 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:00,755 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:00,756 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:00,756 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:00,755 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:00,757 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:00,756 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:00,757 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:00,758 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:00,758 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:00,758 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:00,758 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:00,758 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:00,760 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,760 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,761 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,761 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,761 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,761 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:00,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,761 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,761 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,761 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:00,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,761 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,761 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:00,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 07:07:00,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36ef3993[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 07:07:00,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36ef3993[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:00,765 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 07:07:00,765 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:00,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:00,768 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:07:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:00,768 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:00,768 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,768 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:00,768 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. started... 2023-07-24 07:07:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:00,769 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:00,768 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:00,769 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9045717d7bb44adef8a979edf3f98300 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 07:07:00,769 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. started... 2023-07-24 07:07:00,769 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2e4ae4c97e79dc1d0c88e56b91a1935 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 07:07:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:00,784 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/.tmp/cf/c8fc15f47b5e4319a116cdd59520806e 2023-07-24 07:07:00,787 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/.tmp/cf/f4ef8766141c481c97e42bf914e4b5f9 2023-07-24 07:07:00,794 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/.tmp/cf/c8fc15f47b5e4319a116cdd59520806e as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf/c8fc15f47b5e4319a116cdd59520806e 2023-07-24 07:07:00,797 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/.tmp/cf/f4ef8766141c481c97e42bf914e4b5f9 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf/f4ef8766141c481c97e42bf914e4b5f9 2023-07-24 07:07:00,801 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf/c8fc15f47b5e4319a116cdd59520806e, entries=2, sequenceid=6, filesize=5.0 K 2023-07-24 07:07:00,803 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9045717d7bb44adef8a979edf3f98300 in 34ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:00,803 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 07:07:00,804 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9045717d7bb44adef8a979edf3f98300: 2023-07-24 07:07:00,804 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:00,804 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:00,804 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf/c8fc15f47b5e4319a116cdd59520806e] hfiles 2023-07-24 07:07:00,804 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf/c8fc15f47b5e4319a116cdd59520806e for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:00,805 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf/f4ef8766141c481c97e42bf914e4b5f9, entries=48, sequenceid=6, filesize=8.1 K 2023-07-24 07:07:00,811 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for c2e4ae4c97e79dc1d0c88e56b91a1935 in 42ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:00,812 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2e4ae4c97e79dc1d0c88e56b91a1935: 2023-07-24 07:07:00,812 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:00,812 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:00,812 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf/f4ef8766141c481c97e42bf914e4b5f9] hfiles 2023-07-24 07:07:00,813 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf/f4ef8766141c481c97e42bf914e4b5f9 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:00,832 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:00,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:07:00,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:00,835 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. completed. 2023-07-24 07:07:00,835 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:00,835 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:00,835 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:00,835 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:00,835 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,835 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:00,835 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:07:00,835 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. completed. 2023-07-24 07:07:00,835 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:00,836 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:00,836 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:00,836 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,836 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:00,836 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:07:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:00,840 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:00,843 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,843 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:00,843 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:00,843 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44253,1690182392310': 2023-07-24 07:07:00,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 07:07:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43589,1690182392179': 2023-07-24 07:07:00,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 07:07:00,853 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 07:07:00,853 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:00,853 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:00,853 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 07:07:00,853 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:00,855 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,855 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,855 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:00,855 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,855 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,855 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,856 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,857 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:00,858 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,858 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:00,860 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,861 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,861 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:00,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,866 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:00,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,868 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 07:07:00,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 07:07:00,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:00,866 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:00,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:00,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,868 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,869 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:00,869 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,869 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:00,869 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:00,869 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,869 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:00,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:00,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 07:07:00,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,919 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:00,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690182420730Consolidate snapshot: snaptb0-testExportFileSystemState at 1690182420868 (+138 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690182420868Writing data manifest for snaptb0-testExportFileSystemState at 1690182420873 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690182420884 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690182420918 (+34 ms) 2023-07-24 07:07:00,922 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:00,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 191 msec 2023-07-24 07:07:01,035 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:01,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:07:01,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:01,036 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036 2023-07-24 07:07:01,037 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42803, tgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036, rawTgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036, srcFsUri=hdfs://localhost:42803, srcDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:07:01,062 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:07:01,062 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1792441550_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:01,062 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499, snapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 07:07:01,077 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:01,111 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,111 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,112 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,112 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,112 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,113 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,113 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,182 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop-1457416809473683892.jar 2023-07-24 07:07:01,183 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,183 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,184 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,184 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,184 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,184 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:01,185 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:07:01,185 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:07:01,186 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:07:01,186 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:07:01,186 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:07:01,187 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:07:01,187 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:07:01,187 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:07:01,188 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:07:01,188 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:07:01,189 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:01,189 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:01,189 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:01,190 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:01,190 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:01,190 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:01,191 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:01,641 WARN [Listener at jenkins-hbase4.apache.org/46687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:07:01,644 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 07:07:01,647 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 07:07:03,342 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:03,342 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:03,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0001_000001 (auth:SIMPLE) 2023-07-24 07:07:04,152 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:04,916 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:07:08,436 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:10,726 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:13,501 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:14,852 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:07:14,853 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:07:14,861 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 07:07:14,861 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:07:14,862 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:07:14,862 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 07:07:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 07:07:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 07:07:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 07:07:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 07:07:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182421036/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 07:07:14,871 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 07:07:14,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 07:07:14,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:14,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 07:07:14,878 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182434878"}]},"ts":"1690182434878"} 2023-07-24 07:07:14,880 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 07:07:14,881 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 07:07:14,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9045717d7bb44adef8a979edf3f98300, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2e4ae4c97e79dc1d0c88e56b91a1935, UNASSIGN}] 2023-07-24 07:07:14,885 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9045717d7bb44adef8a979edf3f98300, UNASSIGN 2023-07-24 07:07:14,885 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2e4ae4c97e79dc1d0c88e56b91a1935, UNASSIGN 2023-07-24 07:07:14,886 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9045717d7bb44adef8a979edf3f98300, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:14,886 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c2e4ae4c97e79dc1d0c88e56b91a1935, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:14,886 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182434886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182434886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182434886"}]},"ts":"1690182434886"} 2023-07-24 07:07:14,886 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182434886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182434886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182434886"}]},"ts":"1690182434886"} 2023-07-24 07:07:14,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9045717d7bb44adef8a979edf3f98300, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:07:14,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure c2e4ae4c97e79dc1d0c88e56b91a1935, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:07:14,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 07:07:15,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:15,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9045717d7bb44adef8a979edf3f98300, disabling compactions & flushes 2023-07-24 07:07:15,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:15,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:15,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. after waiting 0 ms 2023-07-24 07:07:15,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:15,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:15,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2e4ae4c97e79dc1d0c88e56b91a1935, disabling compactions & flushes 2023-07-24 07:07:15,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:15,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:15,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. after waiting 0 ms 2023-07-24 07:07:15,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:15,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:15,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300. 2023-07-24 07:07:15,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9045717d7bb44adef8a979edf3f98300: 2023-07-24 07:07:15,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:15,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:15,065 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9045717d7bb44adef8a979edf3f98300, regionState=CLOSED 2023-07-24 07:07:15,065 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182435065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182435065"}]},"ts":"1690182435065"} 2023-07-24 07:07:15,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:15,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935. 2023-07-24 07:07:15,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2e4ae4c97e79dc1d0c88e56b91a1935: 2023-07-24 07:07:15,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:15,070 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c2e4ae4c97e79dc1d0c88e56b91a1935, regionState=CLOSED 2023-07-24 07:07:15,070 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182435070"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182435070"}]},"ts":"1690182435070"} 2023-07-24 07:07:15,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 07:07:15,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9045717d7bb44adef8a979edf3f98300, server=jenkins-hbase4.apache.org,43589,1690182392179 in 180 msec 2023-07-24 07:07:15,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9045717d7bb44adef8a979edf3f98300, UNASSIGN in 190 msec 2023-07-24 07:07:15,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 07:07:15,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure c2e4ae4c97e79dc1d0c88e56b91a1935, server=jenkins-hbase4.apache.org,44253,1690182392310 in 184 msec 2023-07-24 07:07:15,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-24 07:07:15,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2e4ae4c97e79dc1d0c88e56b91a1935, UNASSIGN in 193 msec 2023-07-24 07:07:15,079 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182435078"}]},"ts":"1690182435078"} 2023-07-24 07:07:15,080 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 07:07:15,083 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 07:07:15,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 212 msec 2023-07-24 07:07:15,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 07:07:15,181 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 07:07:15,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 07:07:15,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:15,186 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:15,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 07:07:15,187 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:15,188 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 07:07:15,191 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:15,191 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:15,191 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:15,191 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:15,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 07:07:15,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 07:07:15,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 07:07:15,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 07:07:15,193 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:15,193 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:15,193 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:15,194 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:15,194 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:15,194 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:15,195 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:15,195 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:15,196 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:15,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 07:07:15,196 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:15,198 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/recovered.edits] 2023-07-24 07:07:15,198 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/recovered.edits] 2023-07-24 07:07:15,203 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf/c8fc15f47b5e4319a116cdd59520806e to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/cf/c8fc15f47b5e4319a116cdd59520806e 2023-07-24 07:07:15,203 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf/f4ef8766141c481c97e42bf914e4b5f9 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/cf/f4ef8766141c481c97e42bf914e4b5f9 2023-07-24 07:07:15,208 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300/recovered.edits/9.seqid 2023-07-24 07:07:15,208 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935/recovered.edits/9.seqid 2023-07-24 07:07:15,209 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/9045717d7bb44adef8a979edf3f98300 2023-07-24 07:07:15,209 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemState/c2e4ae4c97e79dc1d0c88e56b91a1935 2023-07-24 07:07:15,209 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 07:07:15,212 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:15,215 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 07:07:15,217 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 07:07:15,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:15,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 07:07:15,219 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182435218"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:15,219 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182435218"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:15,221 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:07:15,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9045717d7bb44adef8a979edf3f98300, NAME => 'testtb-testExportFileSystemState,,1690182419667.9045717d7bb44adef8a979edf3f98300.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c2e4ae4c97e79dc1d0c88e56b91a1935, NAME => 'testtb-testExportFileSystemState,1,1690182419667.c2e4ae4c97e79dc1d0c88e56b91a1935.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:07:15,221 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 07:07:15,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182435221"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:15,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 07:07:15,226 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:15,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 44 msec 2023-07-24 07:07:15,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 07:07:15,298 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 07:07:15,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 07:07:15,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:15,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 07:07:15,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 07:07:15,340 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=769 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:45332 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_35834413_1 at /127.0.0.1:48716 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:48746 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_35834413_1 at /127.0.0.1:45302 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2066 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:39889 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1653125208_17 at /127.0.0.1:59052 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 249) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=5782 (was 5832) 2023-07-24 07:07:15,340 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-24 07:07:15,361 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=769, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=182, AvailableMemoryMB=5777 2023-07-24 07:07:15,361 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-24 07:07:15,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:07:15,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:15,368 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:07:15,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 07:07:15,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:15,372 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:07:15,375 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:15,376 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3 empty. 2023-07-24 07:07:15,379 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:15,379 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:15,380 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8 empty. 2023-07-24 07:07:15,381 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:15,381 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 07:07:15,419 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 07:07:15,420 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 00506495c7d1f6263e8a1c005bef7ce3, NAME => 'testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:07:15,421 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => c5d507e8389b9a0f01c53eef15f7aae8, NAME => 'testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:07:15,462 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:15,462 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 00506495c7d1f6263e8a1c005bef7ce3, disabling compactions & flushes 2023-07-24 07:07:15,462 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:15,462 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:15,463 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. after waiting 0 ms 2023-07-24 07:07:15,463 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:15,463 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:15,463 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 00506495c7d1f6263e8a1c005bef7ce3: 2023-07-24 07:07:15,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:15,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:15,863 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:15,863 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing c5d507e8389b9a0f01c53eef15f7aae8, disabling compactions & flushes 2023-07-24 07:07:15,863 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:15,863 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:15,864 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. after waiting 1 ms 2023-07-24 07:07:15,864 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:15,864 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:15,864 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for c5d507e8389b9a0f01c53eef15f7aae8: 2023-07-24 07:07:15,867 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:07:15,868 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182435868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182435868"}]},"ts":"1690182435868"} 2023-07-24 07:07:15,868 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182435868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182435868"}]},"ts":"1690182435868"} 2023-07-24 07:07:15,877 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:07:15,879 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:07:15,879 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182435879"}]},"ts":"1690182435879"} 2023-07-24 07:07:15,880 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 07:07:15,884 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:07:15,885 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:07:15,886 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:07:15,886 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:07:15,886 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:07:15,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=00506495c7d1f6263e8a1c005bef7ce3, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5d507e8389b9a0f01c53eef15f7aae8, ASSIGN}] 2023-07-24 07:07:15,889 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=00506495c7d1f6263e8a1c005bef7ce3, ASSIGN 2023-07-24 07:07:15,890 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=00506495c7d1f6263e8a1c005bef7ce3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33211,1690182392248; forceNewPlan=false, retain=false 2023-07-24 07:07:15,891 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5d507e8389b9a0f01c53eef15f7aae8, ASSIGN 2023-07-24 07:07:15,892 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5d507e8389b9a0f01c53eef15f7aae8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43589,1690182392179; forceNewPlan=false, retain=false 2023-07-24 07:07:15,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:16,040 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:07:16,043 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c5d507e8389b9a0f01c53eef15f7aae8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,043 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=00506495c7d1f6263e8a1c005bef7ce3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,043 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182436043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182436043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182436043"}]},"ts":"1690182436043"} 2023-07-24 07:07:16,043 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182436043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182436043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182436043"}]},"ts":"1690182436043"} 2023-07-24 07:07:16,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure c5d507e8389b9a0f01c53eef15f7aae8, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:07:16,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 00506495c7d1f6263e8a1c005bef7ce3, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:07:16,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:16,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c5d507e8389b9a0f01c53eef15f7aae8, NAME => 'testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:07:16,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. service=AccessControlService 2023-07-24 07:07:16,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:16,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:16,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:16,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:16,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:16,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 00506495c7d1f6263e8a1c005bef7ce3, NAME => 'testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:07:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. service=AccessControlService 2023-07-24 07:07:16,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:16,209 INFO [StoreOpener-00506495c7d1f6263e8a1c005bef7ce3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:16,211 INFO [StoreOpener-c5d507e8389b9a0f01c53eef15f7aae8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:16,212 DEBUG [StoreOpener-00506495c7d1f6263e8a1c005bef7ce3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf 2023-07-24 07:07:16,212 DEBUG [StoreOpener-00506495c7d1f6263e8a1c005bef7ce3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf 2023-07-24 07:07:16,212 DEBUG [StoreOpener-c5d507e8389b9a0f01c53eef15f7aae8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf 2023-07-24 07:07:16,212 DEBUG [StoreOpener-c5d507e8389b9a0f01c53eef15f7aae8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf 2023-07-24 07:07:16,212 INFO [StoreOpener-00506495c7d1f6263e8a1c005bef7ce3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00506495c7d1f6263e8a1c005bef7ce3 columnFamilyName cf 2023-07-24 07:07:16,213 INFO [StoreOpener-c5d507e8389b9a0f01c53eef15f7aae8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5d507e8389b9a0f01c53eef15f7aae8 columnFamilyName cf 2023-07-24 07:07:16,213 INFO [StoreOpener-00506495c7d1f6263e8a1c005bef7ce3-1] regionserver.HStore(310): Store=00506495c7d1f6263e8a1c005bef7ce3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:16,213 INFO [StoreOpener-c5d507e8389b9a0f01c53eef15f7aae8-1] regionserver.HStore(310): Store=c5d507e8389b9a0f01c53eef15f7aae8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:16,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:16,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:16,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:16,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:16,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:16,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:16,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:16,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c5d507e8389b9a0f01c53eef15f7aae8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69555603, jitterRate=0.03645925223827362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:16,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:16,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c5d507e8389b9a0f01c53eef15f7aae8: 2023-07-24 07:07:16,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 00506495c7d1f6263e8a1c005bef7ce3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61019404, jitterRate=-0.09074002504348755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:16,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 00506495c7d1f6263e8a1c005bef7ce3: 2023-07-24 07:07:16,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8., pid=45, masterSystemTime=1690182436197 2023-07-24 07:07:16,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3., pid=46, masterSystemTime=1690182436200 2023-07-24 07:07:16,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:16,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:16,225 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c5d507e8389b9a0f01c53eef15f7aae8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:16,225 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182436225"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182436225"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182436225"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182436225"}]},"ts":"1690182436225"} 2023-07-24 07:07:16,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:16,226 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=00506495c7d1f6263e8a1c005bef7ce3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,226 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182436226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182436226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182436226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182436226"}]},"ts":"1690182436226"} 2023-07-24 07:07:16,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-24 07:07:16,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure c5d507e8389b9a0f01c53eef15f7aae8, server=jenkins-hbase4.apache.org,43589,1690182392179 in 182 msec 2023-07-24 07:07:16,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-24 07:07:16,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 00506495c7d1f6263e8a1c005bef7ce3, server=jenkins-hbase4.apache.org,33211,1690182392248 in 182 msec 2023-07-24 07:07:16,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5d507e8389b9a0f01c53eef15f7aae8, ASSIGN in 344 msec 2023-07-24 07:07:16,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 07:07:16,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=00506495c7d1f6263e8a1c005bef7ce3, ASSIGN in 345 msec 2023-07-24 07:07:16,234 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:07:16,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182436234"}]},"ts":"1690182436234"} 2023-07-24 07:07:16,236 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 07:07:16,238 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:07:16,238 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 07:07:16,240 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 07:07:16,243 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:16,243 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:16,243 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:16,243 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:16,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:16,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:16,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:16,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:16,246 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 880 msec 2023-07-24 07:07:16,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:16,476 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 07:07:16,476 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-24 07:07:16,476 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:16,480 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-24 07:07:16,480 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:16,480 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-24 07:07:16,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:16,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182436484 (current time:1690182436484). 2023-07-24 07:07:16,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:16,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x5499d394 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:16,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@707fc89f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:16,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:16,500 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:16,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5499d394 to 127.0.0.1:64453 2023-07-24 07:07:16,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:16,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x707e6a83 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:16,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a61026b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:16,510 DEBUG [hconnection-0x64541488-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:16,514 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:16,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:16,522 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:16,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x707e6a83 to 127.0.0.1:64453 2023-07-24 07:07:16,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:16,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 07:07:16,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:16,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:16,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:16,529 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:16,530 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690183036530 2023-07-24 07:07:16,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:16,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 07:07:16,531 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:16,531 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:16,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:16,535 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:16,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-24 07:07:16,548 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:16,549 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690183036549 2023-07-24 07:07:16,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,577 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 07:07:16,577 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:16,579 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 07:07:16,579 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 07:07:16,579 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,579 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,581 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,581 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,581 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,581 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,581 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,581 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,582 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,582 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:16,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:16,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 07:07:16,583 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:16,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:16,583 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:16,583 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:16,583 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:16,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,583 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:16,583 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:16,585 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:16,588 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:16,585 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:16,588 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:16,588 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:16,589 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:16,589 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:16,589 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:16,589 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:16,590 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,590 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,590 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:16,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:16,591 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,591 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:16,591 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:16,591 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,591 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,591 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:16,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:16,592 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,592 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:16,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:16,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 07:07:16,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a24197e[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:16,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:16,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:16,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:16,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:16,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:16,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 07:07:16,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a24197e[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:16,597 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 07:07:16,597 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,599 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,599 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,599 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:16,599 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:16,599 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:16,600 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:16,600 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. started... 2023-07-24 07:07:16,600 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:16,600 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. started... 2023-07-24 07:07:16,600 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:16,603 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5d507e8389b9a0f01c53eef15f7aae8: 2023-07-24 07:07:16,603 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 00506495c7d1f6263e8a1c005bef7ce3: 2023-07-24 07:07:16,603 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:07:16,603 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,603 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:16,603 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,603 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,603 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:16,604 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:16,603 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:16,604 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:16,611 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:16,611 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:16,611 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:16,628 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. completed. 2023-07-24 07:07:16,628 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:16,628 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:16,628 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:16,628 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,628 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:16,628 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:07:16,630 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:16,630 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,631 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. completed. 2023-07-24 07:07:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:16,631 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:16,631 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:16,631 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:16,633 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:16,633 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:16,633 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,633 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:16,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:16,633 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:16,634 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:07:16,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:16,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:16,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,635 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:16,636 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,637 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:16,637 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:16,637 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:16,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:16,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:07:16,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 07:07:16,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:16,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:16,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:16,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:16,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:16,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43589,1690182392179': 2023-07-24 07:07:16,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 07:07:16,648 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 07:07:16,648 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:16,648 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:16,648 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,648 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:16,650 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:16,650 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:16,650 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,650 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:16,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:16,650 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:16,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:16,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:16,651 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:16,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:16,652 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,652 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:16,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,654 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,654 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,655 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,659 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,659 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,659 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:16,659 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,660 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:16,660 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:16,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:16,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:16,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:16,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:16,662 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:16,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 07:07:16,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,736 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:16,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690182436530Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690182436662 (+132 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690182436662Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690182436672 (+10 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690182436697 (+25 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690182436736 (+39 ms) 2023-07-24 07:07:16,740 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:16,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 209 msec 2023-07-24 07:07:16,835 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:16,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:16,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:16,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33211] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:16,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43589] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:16,850 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 07:07:16,851 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:16,851 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:16,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:16,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182436864 (current time:1690182436864). 2023-07-24 07:07:16,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:16,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x0ff2516a to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:16,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11a2a47b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:16,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:16,884 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:16,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ff2516a to 127.0.0.1:64453 2023-07-24 07:07:16,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:16,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x70cd2a82 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:16,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d294cf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:16,899 DEBUG [hconnection-0x69acbc52-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:16,900 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:16,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:16,907 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:16,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70cd2a82 to 127.0.0.1:64453 2023-07-24 07:07:16,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:16,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 07:07:16,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:16,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:16,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:16,913 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:16,914 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690183036914 2023-07-24 07:07:16,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 07:07:16,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:16,916 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:16,916 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:16,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:16,921 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:16,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-24 07:07:16,923 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:16,924 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690183036924 2023-07-24 07:07:16,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 07:07:16,948 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 07:07:16,948 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:16,950 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 07:07:16,950 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 07:07:16,951 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,951 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,952 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,952 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,952 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,952 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:16,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,953 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:16,953 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,953 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,953 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:16,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:16,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:16,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 07:07:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:16,959 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 07:07:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:16,959 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 07:07:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:16,961 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:16,961 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:16,961 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:16,961 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:16,961 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:16,972 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:16,972 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:16,972 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:16,972 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:16,972 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:16,974 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,975 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,975 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,975 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:16,975 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:16,975 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,976 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,982 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,982 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:16,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:16,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:16,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:16,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:16,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 07:07:16,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dbbb8d5[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:16,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:16,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:16,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:16,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:16,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:16,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:16,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:16,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 07:07:16,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dbbb8d5[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:16,987 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 07:07:16,987 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,994 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,994 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,994 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,995 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:16,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,995 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,995 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:16,995 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:16,995 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:16,995 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:07:16,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:16,995 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:16,997 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:16,997 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:16,997 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:16,997 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:16,997 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:16,998 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:16,998 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:17,000 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:17,000 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:17,000 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. started... 2023-07-24 07:07:17,000 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c5d507e8389b9a0f01c53eef15f7aae8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 07:07:17,008 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:17,008 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:17,009 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:17,009 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. started... 2023-07-24 07:07:17,009 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 00506495c7d1f6263e8a1c005bef7ce3 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 07:07:17,016 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:17,018 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:17,030 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 07:07:17,062 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/.tmp/cf/b49abe43e14941cd9a22f113954d3e2a 2023-07-24 07:07:17,064 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/.tmp/cf/34526a2177504d498bbce2b7f5700c1f 2023-07-24 07:07:17,074 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/.tmp/cf/34526a2177504d498bbce2b7f5700c1f as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf/34526a2177504d498bbce2b7f5700c1f 2023-07-24 07:07:17,075 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/.tmp/cf/b49abe43e14941cd9a22f113954d3e2a as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf/b49abe43e14941cd9a22f113954d3e2a 2023-07-24 07:07:17,081 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf/34526a2177504d498bbce2b7f5700c1f, entries=5, sequenceid=6, filesize=5.2 K 2023-07-24 07:07:17,082 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 00506495c7d1f6263e8a1c005bef7ce3 in 73ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:17,084 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 00506495c7d1f6263e8a1c005bef7ce3: 2023-07-24 07:07:17,084 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:17,085 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:17,085 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf/34526a2177504d498bbce2b7f5700c1f] hfiles 2023-07-24 07:07:17,085 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf/34526a2177504d498bbce2b7f5700c1f for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:17,086 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf/b49abe43e14941cd9a22f113954d3e2a, entries=45, sequenceid=6, filesize=7.9 K 2023-07-24 07:07:17,087 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for c5d507e8389b9a0f01c53eef15f7aae8 in 87ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:17,087 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5d507e8389b9a0f01c53eef15f7aae8: 2023-07-24 07:07:17,087 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:17,088 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:17,088 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf/b49abe43e14941cd9a22f113954d3e2a] hfiles 2023-07-24 07:07:17,088 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf/b49abe43e14941cd9a22f113954d3e2a for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:17,103 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. completed. 2023-07-24 07:07:17,103 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:17,103 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:17,103 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:17,103 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,103 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:17,103 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:07:17,105 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:17,105 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:17,105 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:17,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:17,105 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:17,108 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. completed. 2023-07-24 07:07:17,108 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:17,108 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:17,109 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:17,109 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,109 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:17,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,109 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:07:17,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,110 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:17,111 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:17,111 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:17,111 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:17,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:17,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:07:17,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 07:07:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43589,1690182392179': 2023-07-24 07:07:17,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 07:07:17,129 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 07:07:17,129 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:17,129 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:17,129 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 07:07:17,129 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:17,132 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,132 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,132 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:17,132 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:17,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,132 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,133 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,133 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:17,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:17,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:17,134 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:17,135 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:17,136 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:17,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:17,139 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:17,139 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,140 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,147 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:17,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:17,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:17,147 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 07:07:17,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:17,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:17,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:17,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:17,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,148 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:17,148 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,151 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:17,151 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:17,151 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,151 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,151 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:17,151 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:17,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:17,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:17,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:17,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:17,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:17,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:17,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,218 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:17,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 07:07:17,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:17,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:17,220 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220 2023-07-24 07:07:17,220 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,220 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220, srcFsUri=hdfs://localhost:42803, srcDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:07:17,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690182436914Consolidate snapshot: snaptb0-testConsecutiveExports at 1690182437148 (+234 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690182437148Writing data manifest for snaptb0-testConsecutiveExports at 1690182437174 (+26 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690182437187 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690182437219 (+32 ms) 2023-07-24 07:07:17,223 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:17,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 308 msec 2023-07-24 07:07:17,257 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:07:17,258 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@53df5299, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,258 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499, snapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 07:07:17,266 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:17,278 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,278 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,279 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,279 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,279 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,280 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,280 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,349 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop-8581196206853602483.jar 2023-07-24 07:07:17,350 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,350 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,350 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,351 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,351 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,352 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:17,352 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:07:17,352 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:07:17,353 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:07:17,353 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:07:17,354 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:07:17,354 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:07:17,355 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:07:17,355 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:07:17,355 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:07:17,356 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:07:17,356 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:17,357 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:17,357 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:17,357 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:17,357 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:17,358 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:17,358 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:17,734 WARN [Listener at jenkins-hbase4.apache.org/46687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:07:17,737 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 07:07:17,739 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 07:07:19,678 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:19,678 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:19,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:20,350 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:20,641 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:07:24,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:26,911 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:29,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:30,935 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:07:30,935 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:07:30,939 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 07:07:30,939 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:07:30,939 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:07:30,940 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:30,940 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 07:07:30,940 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 07:07:30,940 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@355c60fa in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:30,941 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 07:07:30,941 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 07:07:30,942 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220, srcFsUri=hdfs://localhost:42803, srcDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:07:30,966 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:07:30,966 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@11caad52, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:30,966 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499, snapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 07:07:30,979 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:30,994 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:30,995 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:30,995 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:30,996 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:30,996 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:30,997 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:30,997 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:31,077 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop-7206480490903081804.jar 2023-07-24 07:07:31,078 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:31,079 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:31,079 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:31,079 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:31,080 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:31,080 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:31,080 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:07:31,081 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:07:31,081 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:07:31,081 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:07:31,082 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:07:31,082 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:07:31,083 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:07:31,083 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:07:31,083 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:07:31,084 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:07:31,084 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:31,085 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:31,085 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:31,085 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:31,086 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:31,086 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:31,086 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:31,533 WARN [Listener at jenkins-hbase4.apache.org/46687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:07:31,536 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 07:07:31,538 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 07:07:36,007 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:36,008 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:36,011 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:36,698 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:40,596 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:42,887 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:46,080 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:47,220 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:07:47,220 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:07:47,233 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 07:07:47,233 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:07:47,233 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:07:47,234 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:47,243 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 07:07:47,243 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 07:07:47,243 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@355c60fa in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:47,244 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 07:07:47,244 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/local-export-1690182437220/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 07:07:47,262 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 07:07:47,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 07:07:47,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:47,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 07:07:47,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182467269"}]},"ts":"1690182467269"} 2023-07-24 07:07:47,275 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 07:07:47,279 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 07:07:47,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=00506495c7d1f6263e8a1c005bef7ce3, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5d507e8389b9a0f01c53eef15f7aae8, UNASSIGN}] 2023-07-24 07:07:47,282 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5d507e8389b9a0f01c53eef15f7aae8, UNASSIGN 2023-07-24 07:07:47,284 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=00506495c7d1f6263e8a1c005bef7ce3, UNASSIGN 2023-07-24 07:07:47,287 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c5d507e8389b9a0f01c53eef15f7aae8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:47,287 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182467287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182467287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182467287"}]},"ts":"1690182467287"} 2023-07-24 07:07:47,287 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=00506495c7d1f6263e8a1c005bef7ce3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:47,288 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182467287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182467287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182467287"}]},"ts":"1690182467287"} 2023-07-24 07:07:47,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure c5d507e8389b9a0f01c53eef15f7aae8, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:07:47,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 00506495c7d1f6263e8a1c005bef7ce3, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:07:47,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 07:07:47,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:47,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:47,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 00506495c7d1f6263e8a1c005bef7ce3, disabling compactions & flushes 2023-07-24 07:07:47,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c5d507e8389b9a0f01c53eef15f7aae8, disabling compactions & flushes 2023-07-24 07:07:47,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:47,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:47,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:47,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:47,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. after waiting 0 ms 2023-07-24 07:07:47,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:47,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. after waiting 0 ms 2023-07-24 07:07:47,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:47,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:47,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:47,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:47,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3. 2023-07-24 07:07:47,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 00506495c7d1f6263e8a1c005bef7ce3: 2023-07-24 07:07:47,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:47,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8. 2023-07-24 07:07:47,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c5d507e8389b9a0f01c53eef15f7aae8: 2023-07-24 07:07:47,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:47,490 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=00506495c7d1f6263e8a1c005bef7ce3, regionState=CLOSED 2023-07-24 07:07:47,491 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182467490"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182467490"}]},"ts":"1690182467490"} 2023-07-24 07:07:47,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:47,499 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c5d507e8389b9a0f01c53eef15f7aae8, regionState=CLOSED 2023-07-24 07:07:47,499 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182467498"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182467498"}]},"ts":"1690182467498"} 2023-07-24 07:07:47,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-24 07:07:47,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 00506495c7d1f6263e8a1c005bef7ce3, server=jenkins-hbase4.apache.org,33211,1690182392248 in 208 msec 2023-07-24 07:07:47,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-24 07:07:47,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure c5d507e8389b9a0f01c53eef15f7aae8, server=jenkins-hbase4.apache.org,43589,1690182392179 in 211 msec 2023-07-24 07:07:47,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=00506495c7d1f6263e8a1c005bef7ce3, UNASSIGN in 237 msec 2023-07-24 07:07:47,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-24 07:07:47,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5d507e8389b9a0f01c53eef15f7aae8, UNASSIGN in 238 msec 2023-07-24 07:07:47,521 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182467521"}]},"ts":"1690182467521"} 2023-07-24 07:07:47,522 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 07:07:47,524 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 07:07:47,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 262 msec 2023-07-24 07:07:47,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 07:07:47,572 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 07:07:47,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 07:07:47,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:47,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:47,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 07:07:47,583 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:47,585 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 07:07:47,595 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:47,595 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:47,596 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:47,596 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:47,596 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:47,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 07:07:47,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 07:07:47,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 07:07:47,597 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 07:07:47,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:47,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:47,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:47,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:47,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:47,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:47,598 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:47,598 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:47,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 07:07:47,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:47,605 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/recovered.edits] 2023-07-24 07:07:47,606 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/recovered.edits] 2023-07-24 07:07:47,613 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf/34526a2177504d498bbce2b7f5700c1f to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/cf/34526a2177504d498bbce2b7f5700c1f 2023-07-24 07:07:47,613 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf/b49abe43e14941cd9a22f113954d3e2a to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/cf/b49abe43e14941cd9a22f113954d3e2a 2023-07-24 07:07:47,618 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8/recovered.edits/9.seqid 2023-07-24 07:07:47,618 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/c5d507e8389b9a0f01c53eef15f7aae8 2023-07-24 07:07:47,629 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3/recovered.edits/9.seqid 2023-07-24 07:07:47,630 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testConsecutiveExports/00506495c7d1f6263e8a1c005bef7ce3 2023-07-24 07:07:47,630 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 07:07:47,633 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:47,635 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 07:07:47,639 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 07:07:47,640 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:47,640 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 07:07:47,641 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182467640"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:47,641 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182467640"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:47,644 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:07:47,644 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 00506495c7d1f6263e8a1c005bef7ce3, NAME => 'testtb-testConsecutiveExports,,1690182435363.00506495c7d1f6263e8a1c005bef7ce3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c5d507e8389b9a0f01c53eef15f7aae8, NAME => 'testtb-testConsecutiveExports,1,1690182435363.c5d507e8389b9a0f01c53eef15f7aae8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:07:47,644 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 07:07:47,644 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182467644"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:47,646 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 07:07:47,654 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:47,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 80 msec 2023-07-24 07:07:47,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 07:07:47,700 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 07:07:47,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 07:07:47,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:47,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 07:07:47,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 07:07:47,760 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 769), OpenFileDescriptor=902 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=388 (was 303) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=5940 (was 5777) - AvailableMemoryMB LEAK? - 2023-07-24 07:07:47,760 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-24 07:07:47,788 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=388, ProcessCount=183, AvailableMemoryMB=5939 2023-07-24 07:07:47,788 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-24 07:07:47,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:07:47,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:47,794 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:07:47,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 07:07:47,796 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:07:47,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 07:07:47,800 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:47,802 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8 empty. 2023-07-24 07:07:47,802 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:47,803 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:47,803 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a empty. 2023-07-24 07:07:47,804 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:47,804 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 07:07:47,839 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 07:07:47,843 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5f44f730cf42ab587cae307e0596f39a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:07:47,843 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9b81c67cef0f6a3296d01e47cb85e0b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:07:47,876 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:47,876 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 5f44f730cf42ab587cae307e0596f39a, disabling compactions & flushes 2023-07-24 07:07:47,876 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:47,876 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:47,876 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. after waiting 0 ms 2023-07-24 07:07:47,876 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:47,876 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:47,876 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 5f44f730cf42ab587cae307e0596f39a: 2023-07-24 07:07:47,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 07:07:47,904 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:47,904 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9b81c67cef0f6a3296d01e47cb85e0b8, disabling compactions & flushes 2023-07-24 07:07:47,904 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:47,904 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:47,904 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. after waiting 0 ms 2023-07-24 07:07:47,904 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:47,904 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:47,904 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9b81c67cef0f6a3296d01e47cb85e0b8: 2023-07-24 07:07:47,910 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:07:47,911 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182467911"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182467911"}]},"ts":"1690182467911"} 2023-07-24 07:07:47,912 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182467911"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182467911"}]},"ts":"1690182467911"} 2023-07-24 07:07:47,920 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:07:47,921 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:07:47,921 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182467921"}]},"ts":"1690182467921"} 2023-07-24 07:07:47,924 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 07:07:47,929 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:07:47,931 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:07:47,931 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:07:47,931 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:07:47,931 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:07:47,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b81c67cef0f6a3296d01e47cb85e0b8, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5f44f730cf42ab587cae307e0596f39a, ASSIGN}] 2023-07-24 07:07:47,934 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b81c67cef0f6a3296d01e47cb85e0b8, ASSIGN 2023-07-24 07:07:47,935 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5f44f730cf42ab587cae307e0596f39a, ASSIGN 2023-07-24 07:07:47,936 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5f44f730cf42ab587cae307e0596f39a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43589,1690182392179; forceNewPlan=false, retain=false 2023-07-24 07:07:47,936 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b81c67cef0f6a3296d01e47cb85e0b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44253,1690182392310; forceNewPlan=false, retain=false 2023-07-24 07:07:48,086 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:07:48,089 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9b81c67cef0f6a3296d01e47cb85e0b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,089 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182468089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182468089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182468089"}]},"ts":"1690182468089"} 2023-07-24 07:07:48,090 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=5f44f730cf42ab587cae307e0596f39a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,090 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182468090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182468090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182468090"}]},"ts":"1690182468090"} 2023-07-24 07:07:48,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 9b81c67cef0f6a3296d01e47cb85e0b8, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:07:48,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 5f44f730cf42ab587cae307e0596f39a, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:07:48,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 07:07:48,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:48,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b81c67cef0f6a3296d01e47cb85e0b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:07:48,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. service=AccessControlService 2023-07-24 07:07:48,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:48,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:48,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:48,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:48,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:48,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:48,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f44f730cf42ab587cae307e0596f39a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:07:48,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. service=AccessControlService 2023-07-24 07:07:48,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:48,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:48,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:48,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:48,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:48,285 INFO [StoreOpener-5f44f730cf42ab587cae307e0596f39a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:48,286 DEBUG [StoreOpener-5f44f730cf42ab587cae307e0596f39a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf 2023-07-24 07:07:48,286 DEBUG [StoreOpener-5f44f730cf42ab587cae307e0596f39a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf 2023-07-24 07:07:48,288 INFO [StoreOpener-5f44f730cf42ab587cae307e0596f39a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f44f730cf42ab587cae307e0596f39a columnFamilyName cf 2023-07-24 07:07:48,289 INFO [StoreOpener-5f44f730cf42ab587cae307e0596f39a-1] regionserver.HStore(310): Store=5f44f730cf42ab587cae307e0596f39a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:48,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:48,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:48,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:07:48,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:48,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f44f730cf42ab587cae307e0596f39a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70435502, jitterRate=0.04957076907157898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:48,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f44f730cf42ab587cae307e0596f39a: 2023-07-24 07:07:48,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a., pid=61, masterSystemTime=1690182468254 2023-07-24 07:07:48,299 INFO [StoreOpener-9b81c67cef0f6a3296d01e47cb85e0b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:48,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:48,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:48,301 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=5f44f730cf42ab587cae307e0596f39a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,301 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182468301"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182468301"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182468301"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182468301"}]},"ts":"1690182468301"} 2023-07-24 07:07:48,303 DEBUG [StoreOpener-9b81c67cef0f6a3296d01e47cb85e0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf 2023-07-24 07:07:48,303 DEBUG [StoreOpener-9b81c67cef0f6a3296d01e47cb85e0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf 2023-07-24 07:07:48,304 INFO [StoreOpener-9b81c67cef0f6a3296d01e47cb85e0b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b81c67cef0f6a3296d01e47cb85e0b8 columnFamilyName cf 2023-07-24 07:07:48,304 INFO [StoreOpener-9b81c67cef0f6a3296d01e47cb85e0b8-1] regionserver.HStore(310): Store=9b81c67cef0f6a3296d01e47cb85e0b8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:48,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:48,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:48,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-24 07:07:48,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 5f44f730cf42ab587cae307e0596f39a, server=jenkins-hbase4.apache.org,43589,1690182392179 in 205 msec 2023-07-24 07:07:48,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5f44f730cf42ab587cae307e0596f39a, ASSIGN in 376 msec 2023-07-24 07:07:48,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:07:48,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:48,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b81c67cef0f6a3296d01e47cb85e0b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69418588, jitterRate=0.034417569637298584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:48,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b81c67cef0f6a3296d01e47cb85e0b8: 2023-07-24 07:07:48,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8., pid=60, masterSystemTime=1690182468250 2023-07-24 07:07:48,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:48,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:48,331 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9b81c67cef0f6a3296d01e47cb85e0b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,331 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182468331"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182468331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182468331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182468331"}]},"ts":"1690182468331"} 2023-07-24 07:07:48,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-24 07:07:48,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 9b81c67cef0f6a3296d01e47cb85e0b8, server=jenkins-hbase4.apache.org,44253,1690182392310 in 239 msec 2023-07-24 07:07:48,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-24 07:07:48,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b81c67cef0f6a3296d01e47cb85e0b8, ASSIGN in 405 msec 2023-07-24 07:07:48,341 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:07:48,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182468341"}]},"ts":"1690182468341"} 2023-07-24 07:07:48,343 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 07:07:48,345 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:07:48,346 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 07:07:48,348 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 07:07:48,350 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:48,350 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:48,350 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:48,350 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:48,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:48,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:48,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:48,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:48,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 561 msec 2023-07-24 07:07:48,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 07:07:48,405 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 07:07:48,405 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-24 07:07:48,405 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:48,423 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-24 07:07:48,423 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:48,423 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-24 07:07:48,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:48,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182468439 (current time:1690182468439). 2023-07-24 07:07:48,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:48,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x716f6be6 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:48,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@668dac99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:48,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:48,457 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:48,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x716f6be6 to 127.0.0.1:64453 2023-07-24 07:07:48,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:48,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x2d252f5a to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:48,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@271f4143, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:48,503 DEBUG [hconnection-0x2cfdc85d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:48,508 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:48,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:48,520 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:48,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d252f5a to 127.0.0.1:64453 2023-07-24 07:07:48,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:48,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 07:07:48,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:48,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:48,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:48,545 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:48,547 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690183068547 2023-07-24 07:07:48,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,552 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:48,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:48,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:48,554 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:48,554 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:48,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-24 07:07:48,556 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:48,557 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690183068557 2023-07-24 07:07:48,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,573 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 07:07:48,573 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:48,576 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 07:07:48,576 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 07:07:48,577 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,577 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,578 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:48,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:48,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:48,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:48,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:48,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:48,580 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:48,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:48,581 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,581 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,581 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,581 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:48,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 07:07:48,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 07:07:48,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:48,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:48,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:48,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 07:07:48,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,584 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:48,586 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:48,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,586 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:48,588 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:48,588 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:48,588 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:48,588 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:48,588 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:48,591 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:48,591 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:48,594 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:48,594 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:48,594 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:48,595 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,595 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,595 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:48,598 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,598 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,598 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,598 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:48,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:48,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:48,599 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,599 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:48,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:48,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,600 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,600 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:48,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:48,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 07:07:48,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@634030c9[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:48,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 07:07:48,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@634030c9[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:48,604 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 07:07:48,604 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,605 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,605 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,605 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,606 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:48,606 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:48,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,606 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:48,606 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,606 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:48,606 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:07:48,607 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,607 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:48,610 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:48,610 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:48,610 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:48,614 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:48,617 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:48,617 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:48,617 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. started... 2023-07-24 07:07:48,617 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:48,617 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:48,618 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b81c67cef0f6a3296d01e47cb85e0b8: 2023-07-24 07:07:48,617 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. started... 2023-07-24 07:07:48,630 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,630 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:48,630 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:48,631 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f44f730cf42ab587cae307e0596f39a: 2023-07-24 07:07:48,634 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,634 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:48,635 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:48,654 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:48,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:48,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:48,663 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:48,693 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. completed. 2023-07-24 07:07:48,693 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:48,694 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:48,694 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:07:48,702 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:48,702 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:48,702 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:48,702 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44253,1690182392310': 2023-07-24 07:07:48,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 07:07:48,729 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. completed. 2023-07-24 07:07:48,729 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:48,729 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:48,729 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:48,729 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,729 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:48,729 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:07:48,731 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:48,731 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:48,731 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:48,731 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43589,1690182392179': 2023-07-24 07:07:48,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 07:07:48,739 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 07:07:48,739 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:48,739 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:48,739 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,739 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:48,741 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:48,741 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:48,741 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:48,741 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:48,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,742 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:48,742 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:48,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,743 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,746 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,746 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:48,747 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,756 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:48,756 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:48,756 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:48,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:48,756 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:48,756 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:48,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:48,756 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,757 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:48,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:48,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,757 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:48,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:48,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:48,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:48,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:48,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:48,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:48,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,863 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:48,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:48,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:48,865 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:07:48,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 07:07:48,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:48,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690182468548Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690182468757 (+209 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690182468757Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690182468766 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690182468779 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690182468892 (+113 ms) 2023-07-24 07:07:48,896 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:48,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 347 msec 2023-07-24 07:07:49,165 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:49,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:49,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:49,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43589] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:49,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44253] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:49,225 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,225 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:49,227 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:49,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:49,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182469252 (current time:1690182469252). 2023-07-24 07:07:49,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:49,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x1127247a to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:49,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51c4889b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:49,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:49,281 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:49,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1127247a to 127.0.0.1:64453 2023-07-24 07:07:49,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:49,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x4e7db073 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:49,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66d15932, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:49,397 DEBUG [hconnection-0x13248523-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:49,402 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:49,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:49,415 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:49,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e7db073 to 127.0.0.1:64453 2023-07-24 07:07:49,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:49,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 07:07:49,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:49,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:49,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:49,427 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:49,428 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690183069428 2023-07-24 07:07:49,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:49,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,428 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:49,430 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:49,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:49,434 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:49,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 11 msec 2023-07-24 07:07:49,438 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:49,441 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690183069441 2023-07-24 07:07:49,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,464 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 07:07:49,465 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:49,466 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 07:07:49,467 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 07:07:49,467 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,467 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,469 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:49,469 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:49,469 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:49,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:49,469 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:49,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:49,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:49,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:49,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,470 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,470 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,470 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,470 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:49,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:49,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,477 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:49,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,477 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:49,478 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:49,479 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:49,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,482 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:49,482 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:49,479 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:49,483 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:49,483 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:49,482 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:49,484 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:49,484 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:49,483 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:49,484 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:49,484 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:49,486 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,486 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,486 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:49,488 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,488 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,488 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,488 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:49,489 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,489 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:49,489 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,489 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:49,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 07:07:49,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c2cae93[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:49,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 07:07:49,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c2cae93[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:49,494 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 07:07:49,494 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,496 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,496 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,496 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:49,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:49,497 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:07:49,497 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:49,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,497 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. started... 2023-07-24 07:07:49,497 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,498 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:49,498 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b81c67cef0f6a3296d01e47cb85e0b8 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-24 07:07:49,498 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:49,498 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:49,498 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:49,498 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. started... 2023-07-24 07:07:49,499 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:49,499 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:49,499 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:49,501 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5f44f730cf42ab587cae307e0596f39a 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-24 07:07:49,536 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:49,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:49,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:49,538 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:49,553 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/.tmp/cf/ba6b83e6796e4a0aaa58266f94fad4b7 2023-07-24 07:07:49,556 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/.tmp/cf/8dc8d8f202084451bc2d2864910448f1 2023-07-24 07:07:49,565 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/.tmp/cf/8dc8d8f202084451bc2d2864910448f1 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf/8dc8d8f202084451bc2d2864910448f1 2023-07-24 07:07:49,575 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/.tmp/cf/ba6b83e6796e4a0aaa58266f94fad4b7 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf/ba6b83e6796e4a0aaa58266f94fad4b7 2023-07-24 07:07:49,579 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf/8dc8d8f202084451bc2d2864910448f1, entries=44, sequenceid=6, filesize=7.8 K 2023-07-24 07:07:49,581 INFO [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 5f44f730cf42ab587cae307e0596f39a in 82ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:49,581 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 07:07:49,581 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f44f730cf42ab587cae307e0596f39a: 2023-07-24 07:07:49,582 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,582 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:49,582 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf/8dc8d8f202084451bc2d2864910448f1] hfiles 2023-07-24 07:07:49,582 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf/8dc8d8f202084451bc2d2864910448f1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,583 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf/ba6b83e6796e4a0aaa58266f94fad4b7, entries=6, sequenceid=6, filesize=5.2 K 2023-07-24 07:07:49,585 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 9b81c67cef0f6a3296d01e47cb85e0b8 in 86ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:49,587 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b81c67cef0f6a3296d01e47cb85e0b8: 2023-07-24 07:07:49,587 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,587 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:49,587 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf/ba6b83e6796e4a0aaa58266f94fad4b7] hfiles 2023-07-24 07:07:49,587 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf/ba6b83e6796e4a0aaa58266f94fad4b7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,625 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. completed. 2023-07-24 07:07:49,625 DEBUG [rs(jenkins-hbase4.apache.org,43589,1690182392179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:07:49,625 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:49,626 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:49,626 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,626 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:49,626 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:07:49,628 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:49,628 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:49,628 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:49,628 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:49,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:49,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43589,1690182392179': 2023-07-24 07:07:49,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 07:07:49,648 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. completed. 2023-07-24 07:07:49,648 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:07:49,648 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:49,648 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:49,648 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,648 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:49,648 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:07:49,650 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,650 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:49,650 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:49,650 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:49,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44253,1690182392310': 2023-07-24 07:07:49,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 07:07:49,657 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 07:07:49,657 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:49,657 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:49,657 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,657 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:49,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:49,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:49,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:49,663 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:49,664 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,665 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,666 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,669 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,669 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:49,670 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,673 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,673 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,674 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:49,674 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:49,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:49,674 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:49,674 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:49,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:49,674 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:49,674 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:49,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:49,675 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:49,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:49,675 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:49,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:49,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:49,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:49,739 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:49,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:49,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:49,752 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:07:49,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 07:07:49,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,985 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:49,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690182469428Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690182469677 (+249 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690182469677Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690182469728 (+51 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690182469823 (+95 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690182469985 (+162 ms) 2023-07-24 07:07:49,989 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:49,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 559 msec 2023-07-24 07:07:50,053 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:50,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:50,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:50,091 DEBUG [Listener at jenkins-hbase4.apache.org/46687] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:07:50,097 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:07:50,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33211] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 07:07:50,100 DEBUG [Listener at jenkins-hbase4.apache.org/46687] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:07:50,103 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:07:50,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43589] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 07:07:50,104 DEBUG [Listener at jenkins-hbase4.apache.org/46687] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:07:50,108 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:07:50,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44253] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 07:07:50,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:07:50,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:50,116 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:07:50,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 07:07:50,117 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:07:50,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 07:07:50,133 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,133 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,133 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58 empty. 2023-07-24 07:07:50,134 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5 empty. 2023-07-24 07:07:50,135 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,141 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,141 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 07:07:50,155 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 07:07:50,157 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a93b4ba5d0297f73c11da44ebc1f0e58, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:07:50,157 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => e6c7ddd1d8cb189a3335d7fc97b16cb5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:07:50,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a93b4ba5d0297f73c11da44ebc1f0e58, disabling compactions & flushes 2023-07-24 07:07:50,204 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. after waiting 0 ms 2023-07-24 07:07:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,204 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a93b4ba5d0297f73c11da44ebc1f0e58: 2023-07-24 07:07:50,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:50,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing e6c7ddd1d8cb189a3335d7fc97b16cb5, disabling compactions & flushes 2023-07-24 07:07:50,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. after waiting 0 ms 2023-07-24 07:07:50,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for e6c7ddd1d8cb189a3335d7fc97b16cb5: 2023-07-24 07:07:50,208 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:07:50,210 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182470210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182470210"}]},"ts":"1690182470210"} 2023-07-24 07:07:50,210 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182470210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182470210"}]},"ts":"1690182470210"} 2023-07-24 07:07:50,213 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:07:50,214 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:07:50,214 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182470214"}]},"ts":"1690182470214"} 2023-07-24 07:07:50,216 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 07:07:50,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 07:07:50,221 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:07:50,222 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:07:50,222 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:07:50,222 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:07:50,222 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:07:50,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a93b4ba5d0297f73c11da44ebc1f0e58, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6c7ddd1d8cb189a3335d7fc97b16cb5, ASSIGN}] 2023-07-24 07:07:50,228 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6c7ddd1d8cb189a3335d7fc97b16cb5, ASSIGN 2023-07-24 07:07:50,228 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a93b4ba5d0297f73c11da44ebc1f0e58, ASSIGN 2023-07-24 07:07:50,229 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a93b4ba5d0297f73c11da44ebc1f0e58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33211,1690182392248; forceNewPlan=false, retain=false 2023-07-24 07:07:50,229 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6c7ddd1d8cb189a3335d7fc97b16cb5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43589,1690182392179; forceNewPlan=false, retain=false 2023-07-24 07:07:50,380 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:07:50,383 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=e6c7ddd1d8cb189a3335d7fc97b16cb5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:50,383 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a93b4ba5d0297f73c11da44ebc1f0e58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:50,384 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182470383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182470383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182470383"}]},"ts":"1690182470383"} 2023-07-24 07:07:50,384 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182470383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182470383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182470383"}]},"ts":"1690182470383"} 2023-07-24 07:07:50,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure e6c7ddd1d8cb189a3335d7fc97b16cb5, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:07:50,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure a93b4ba5d0297f73c11da44ebc1f0e58, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:07:50,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 07:07:50,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a93b4ba5d0297f73c11da44ebc1f0e58, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 07:07:50,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6c7ddd1d8cb189a3335d7fc97b16cb5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 07:07:50,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. service=AccessControlService 2023-07-24 07:07:50,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. service=AccessControlService 2023-07-24 07:07:50,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:50,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:50,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,552 INFO [StoreOpener-a93b4ba5d0297f73c11da44ebc1f0e58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,560 INFO [StoreOpener-e6c7ddd1d8cb189a3335d7fc97b16cb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,563 DEBUG [StoreOpener-e6c7ddd1d8cb189a3335d7fc97b16cb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf 2023-07-24 07:07:50,563 DEBUG [StoreOpener-e6c7ddd1d8cb189a3335d7fc97b16cb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf 2023-07-24 07:07:50,563 INFO [StoreOpener-e6c7ddd1d8cb189a3335d7fc97b16cb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6c7ddd1d8cb189a3335d7fc97b16cb5 columnFamilyName cf 2023-07-24 07:07:50,565 INFO [StoreOpener-e6c7ddd1d8cb189a3335d7fc97b16cb5-1] regionserver.HStore(310): Store=e6c7ddd1d8cb189a3335d7fc97b16cb5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:50,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,570 DEBUG [StoreOpener-a93b4ba5d0297f73c11da44ebc1f0e58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf 2023-07-24 07:07:50,570 DEBUG [StoreOpener-a93b4ba5d0297f73c11da44ebc1f0e58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf 2023-07-24 07:07:50,571 INFO [StoreOpener-a93b4ba5d0297f73c11da44ebc1f0e58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a93b4ba5d0297f73c11da44ebc1f0e58 columnFamilyName cf 2023-07-24 07:07:50,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,571 INFO [StoreOpener-a93b4ba5d0297f73c11da44ebc1f0e58-1] regionserver.HStore(310): Store=a93b4ba5d0297f73c11da44ebc1f0e58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:50,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:50,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:50,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e6c7ddd1d8cb189a3335d7fc97b16cb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59665286, jitterRate=-0.11091795563697815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:50,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a93b4ba5d0297f73c11da44ebc1f0e58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71412033, jitterRate=0.06412221491336823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:50,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e6c7ddd1d8cb189a3335d7fc97b16cb5: 2023-07-24 07:07:50,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a93b4ba5d0297f73c11da44ebc1f0e58: 2023-07-24 07:07:50,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58., pid=70, masterSystemTime=1690182470543 2023-07-24 07:07:50,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5., pid=69, masterSystemTime=1690182470543 2023-07-24 07:07:50,600 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a93b4ba5d0297f73c11da44ebc1f0e58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:50,600 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182470600"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182470600"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182470600"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182470600"}]},"ts":"1690182470600"} 2023-07-24 07:07:50,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,606 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=e6c7ddd1d8cb189a3335d7fc97b16cb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:50,606 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182470605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182470605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182470605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182470605"}]},"ts":"1690182470605"} 2023-07-24 07:07:50,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 07:07:50,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure a93b4ba5d0297f73c11da44ebc1f0e58, server=jenkins-hbase4.apache.org,33211,1690182392248 in 219 msec 2023-07-24 07:07:50,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 07:07:50,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure e6c7ddd1d8cb189a3335d7fc97b16cb5, server=jenkins-hbase4.apache.org,43589,1690182392179 in 222 msec 2023-07-24 07:07:50,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a93b4ba5d0297f73c11da44ebc1f0e58, ASSIGN in 390 msec 2023-07-24 07:07:50,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-24 07:07:50,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6c7ddd1d8cb189a3335d7fc97b16cb5, ASSIGN in 391 msec 2023-07-24 07:07:50,616 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:07:50,617 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182470616"}]},"ts":"1690182470616"} 2023-07-24 07:07:50,618 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 07:07:50,621 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:07:50,622 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 07:07:50,624 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 07:07:50,626 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:50,626 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:50,626 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:50,626 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:50,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:50,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:50,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:50,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:50,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:50,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:50,630 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:50,630 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:50,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 519 msec 2023-07-24 07:07:50,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 07:07:50,726 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 07:07:50,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a93b4ba5d0297f73c11da44ebc1f0e58, e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a93b4ba5d0297f73c11da44ebc1f0e58, e6c7ddd1d8cb189a3335d7fc97b16cb5], force=true 2023-07-24 07:07:50,771 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a93b4ba5d0297f73c11da44ebc1f0e58, e6c7ddd1d8cb189a3335d7fc97b16cb5], force=true 2023-07-24 07:07:50,771 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a93b4ba5d0297f73c11da44ebc1f0e58, e6c7ddd1d8cb189a3335d7fc97b16cb5], force=true 2023-07-24 07:07:50,772 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a93b4ba5d0297f73c11da44ebc1f0e58, e6c7ddd1d8cb189a3335d7fc97b16cb5], force=true 2023-07-24 07:07:50,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:50,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a93b4ba5d0297f73c11da44ebc1f0e58, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6c7ddd1d8cb189a3335d7fc97b16cb5, UNASSIGN}] 2023-07-24 07:07:50,813 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6c7ddd1d8cb189a3335d7fc97b16cb5, UNASSIGN 2023-07-24 07:07:50,813 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a93b4ba5d0297f73c11da44ebc1f0e58, UNASSIGN 2023-07-24 07:07:50,814 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a93b4ba5d0297f73c11da44ebc1f0e58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:50,814 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=e6c7ddd1d8cb189a3335d7fc97b16cb5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:50,814 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182470814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182470814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182470814"}]},"ts":"1690182470814"} 2023-07-24 07:07:50,814 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182470814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182470814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182470814"}]},"ts":"1690182470814"} 2023-07-24 07:07:50,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure e6c7ddd1d8cb189a3335d7fc97b16cb5, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:07:50,818 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure a93b4ba5d0297f73c11da44ebc1f0e58, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:07:50,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:50,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:50,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:50,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e6c7ddd1d8cb189a3335d7fc97b16cb5, disabling compactions & flushes 2023-07-24 07:07:50,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a93b4ba5d0297f73c11da44ebc1f0e58, disabling compactions & flushes 2023-07-24 07:07:50,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. after waiting 0 ms 2023-07-24 07:07:50,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. after waiting 0 ms 2023-07-24 07:07:50,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:50,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e6c7ddd1d8cb189a3335d7fc97b16cb5 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 07:07:50,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:50,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a93b4ba5d0297f73c11da44ebc1f0e58 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 07:07:51,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/.tmp/cf/971823d1dd0b4247a3d0b1ff6384678b 2023-07-24 07:07:51,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/.tmp/cf/4bc1f8da3319404b81fda2fccca886e3 2023-07-24 07:07:51,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/.tmp/cf/971823d1dd0b4247a3d0b1ff6384678b as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf/971823d1dd0b4247a3d0b1ff6384678b 2023-07-24 07:07:51,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/.tmp/cf/4bc1f8da3319404b81fda2fccca886e3 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf/4bc1f8da3319404b81fda2fccca886e3 2023-07-24 07:07:51,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf/4bc1f8da3319404b81fda2fccca886e3, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 07:07:51,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a93b4ba5d0297f73c11da44ebc1f0e58 in 106ms, sequenceid=5, compaction requested=false 2023-07-24 07:07:51,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 07:07:51,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf/971823d1dd0b4247a3d0b1ff6384678b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 07:07:51,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:51,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e6c7ddd1d8cb189a3335d7fc97b16cb5 in 114ms, sequenceid=5, compaction requested=false 2023-07-24 07:07:51,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 07:07:51,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:51,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58. 2023-07-24 07:07:51,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a93b4ba5d0297f73c11da44ebc1f0e58: 2023-07-24 07:07:51,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:07:51,107 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a93b4ba5d0297f73c11da44ebc1f0e58, regionState=CLOSED 2023-07-24 07:07:51,107 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182471107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182471107"}]},"ts":"1690182471107"} 2023-07-24 07:07:51,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-24 07:07:51,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure a93b4ba5d0297f73c11da44ebc1f0e58, server=jenkins-hbase4.apache.org,33211,1690182392248 in 302 msec 2023-07-24 07:07:51,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a93b4ba5d0297f73c11da44ebc1f0e58, UNASSIGN in 317 msec 2023-07-24 07:07:51,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 07:07:51,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:51,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5. 2023-07-24 07:07:51,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e6c7ddd1d8cb189a3335d7fc97b16cb5: 2023-07-24 07:07:51,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:07:51,139 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=e6c7ddd1d8cb189a3335d7fc97b16cb5, regionState=CLOSED 2023-07-24 07:07:51,139 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182471139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182471139"}]},"ts":"1690182471139"} 2023-07-24 07:07:51,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-24 07:07:51,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure e6c7ddd1d8cb189a3335d7fc97b16cb5, server=jenkins-hbase4.apache.org,43589,1690182392179 in 327 msec 2023-07-24 07:07:51,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-24 07:07:51,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6c7ddd1d8cb189a3335d7fc97b16cb5, UNASSIGN in 340 msec 2023-07-24 07:07:51,288 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 07:07:51,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470110.a93b4ba5d0297f73c11da44ebc1f0e58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:51,291 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182470110.e6c7ddd1d8cb189a3335d7fc97b16cb5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:51,291 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:51,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e85d63016f54f16b2f3c954a23230f58, ASSIGN}] 2023-07-24 07:07:51,355 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e85d63016f54f16b2f3c954a23230f58, ASSIGN 2023-07-24 07:07:51,356 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e85d63016f54f16b2f3c954a23230f58, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33211,1690182392248; forceNewPlan=false, retain=false 2023-07-24 07:07:51,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:51,506 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 07:07:51,509 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e85d63016f54f16b2f3c954a23230f58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,509 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690182471509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182471509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182471509"}]},"ts":"1690182471509"} 2023-07-24 07:07:51,512 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure e85d63016f54f16b2f3c954a23230f58, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:07:51,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:07:51,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e85d63016f54f16b2f3c954a23230f58, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:07:51,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. service=AccessControlService 2023-07-24 07:07:51,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:51,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:07:51,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:51,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:07:51,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:07:51,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/.regioninfo 2023-07-24 07:07:51,686 INFO [StoreOpener-e85d63016f54f16b2f3c954a23230f58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:07:51,687 DEBUG [StoreOpener-e85d63016f54f16b2f3c954a23230f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf 2023-07-24 07:07:51,688 DEBUG [StoreOpener-e85d63016f54f16b2f3c954a23230f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf 2023-07-24 07:07:51,688 INFO [StoreOpener-e85d63016f54f16b2f3c954a23230f58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e85d63016f54f16b2f3c954a23230f58 columnFamilyName cf 2023-07-24 07:07:51,721 DEBUG [StoreOpener-e85d63016f54f16b2f3c954a23230f58-1] regionserver.HStore(539): loaded hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/4bc1f8da3319404b81fda2fccca886e3.a93b4ba5d0297f73c11da44ebc1f0e58->hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf/4bc1f8da3319404b81fda2fccca886e3-top 2023-07-24 07:07:51,730 DEBUG [StoreOpener-e85d63016f54f16b2f3c954a23230f58-1] regionserver.HStore(539): loaded hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/971823d1dd0b4247a3d0b1ff6384678b.e6c7ddd1d8cb189a3335d7fc97b16cb5->hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf/971823d1dd0b4247a3d0b1ff6384678b-top 2023-07-24 07:07:51,731 INFO [StoreOpener-e85d63016f54f16b2f3c954a23230f58-1] regionserver.HStore(310): Store=e85d63016f54f16b2f3c954a23230f58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:51,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:07:51,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:07:51,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:07:51,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e85d63016f54f16b2f3c954a23230f58; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64447912, jitterRate=-0.03965127468109131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:51,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e85d63016f54f16b2f3c954a23230f58: 2023-07-24 07:07:51,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58., pid=77, masterSystemTime=1690182471665 2023-07-24 07:07:51,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.,because compaction is disabled. 2023-07-24 07:07:51,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:07:51,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:07:51,747 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e85d63016f54f16b2f3c954a23230f58, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,747 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690182471747"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182471747"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182471747"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182471747"}]},"ts":"1690182471747"} 2023-07-24 07:07:51,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 07:07:51,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure e85d63016f54f16b2f3c954a23230f58, server=jenkins-hbase4.apache.org,33211,1690182392248 in 237 msec 2023-07-24 07:07:51,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 07:07:51,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e85d63016f54f16b2f3c954a23230f58, ASSIGN in 399 msec 2023-07-24 07:07:51,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a93b4ba5d0297f73c11da44ebc1f0e58, e6c7ddd1d8cb189a3335d7fc97b16cb5], force=true in 995 msec 2023-07-24 07:07:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:51,889 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 07:07:51,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 07:07:51,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182471890 (current time:1690182471890). 2023-07-24 07:07:51,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:51,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x4d8154f7 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:51,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@677de865, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:51,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:51,901 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:51,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d8154f7 to 127.0.0.1:64453 2023-07-24 07:07:51,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:51,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x795f9af2 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:51,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ebe5fc2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:51,909 DEBUG [hconnection-0x3608b6b0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:51,912 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:51,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:51,919 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:51,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x795f9af2 to 127.0.0.1:64453 2023-07-24 07:07:51,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:51,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 07:07:51,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:51,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 07:07:51,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 07:07:51,924 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 07:07:51,925 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690183071925 2023-07-24 07:07:51,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 07:07:51,930 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:51,930 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:51,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 07:07:51,931 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 07:07:51,932 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-24 07:07:51,934 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 07:07:51,934 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690183071934 2023-07-24 07:07:51,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,951 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 07:07:51,951 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:51,953 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 07:07:51,953 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 07:07:51,953 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,954 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,955 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:51,955 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:51,955 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:51,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:51,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:51,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:51,955 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,956 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 07:07:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 07:07:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 07:07:51,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 07:07:51,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,958 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 07:07:51,958 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:51,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,959 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 07:07:51,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:51,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 07:07:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 07:07:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 07:07:51,960 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 07:07:51,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,961 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 07:07:51,961 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 07:07:51,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,962 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 07:07:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 07:07:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:51,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 07:07:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:51,965 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 07:07:51,965 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 07:07:51,965 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 07:07:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,967 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:51,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:51,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 07:07:51,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16f9bd81[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:51,969 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 07:07:51,969 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 07:07:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,971 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:51,971 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:07:51,972 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. started... 2023-07-24 07:07:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 07:07:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 07:07:51,974 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:51,974 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 07:07:51,976 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 07:07:51,980 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e85d63016f54f16b2f3c954a23230f58: 2023-07-24 07:07:51,981 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,981 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:51,981 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/4bc1f8da3319404b81fda2fccca886e3.a93b4ba5d0297f73c11da44ebc1f0e58->hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf/4bc1f8da3319404b81fda2fccca886e3-top, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/971823d1dd0b4247a3d0b1ff6384678b.e6c7ddd1d8cb189a3335d7fc97b16cb5->hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf/971823d1dd0b4247a3d0b1ff6384678b-top] hfiles 2023-07-24 07:07:51,981 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/4bc1f8da3319404b81fda2fccca886e3.a93b4ba5d0297f73c11da44ebc1f0e58 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,982 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/971823d1dd0b4247a3d0b1ff6384678b.e6c7ddd1d8cb189a3335d7fc97b16cb5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:51,994 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. completed. 2023-07-24 07:07:51,994 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:07:51,994 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:51,994 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:51,995 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:51,995 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 07:07:51,995 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:07:52,000 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 07:07:52,000 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,001 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:52,001 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 07:07:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:07:52,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 07:07:52,004 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 07:07:52,004 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:52,004 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:52,004 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,004 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:52,008 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:52,008 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,009 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,008 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:52,009 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:52,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:52,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:52,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:52,010 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:52,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:52,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:52,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,016 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:52,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:52,016 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:52,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,017 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:52,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,020 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,020 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:52,020 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:52,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:52,020 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:52,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:52,020 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:52,020 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:52,020 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:52,020 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:52,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:52,020 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:52,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,020 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,021 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:52,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:52,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:52,030 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:52,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 07:07:52,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:52,032 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:52,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,072 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 07:07:52,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,073 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690182471925Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690182472021 (+96 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690182472021Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690182472026 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690182472041 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690182472072 (+31 ms) 2023-07-24 07:07:52,076 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 07:07:52,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 147 msec 2023-07-24 07:07:52,232 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:52,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 07:07:52,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:52,233 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233 2023-07-24 07:07:52,234 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42803, tgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233, rawTgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233, srcFsUri=hdfs://localhost:42803, srcDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:07:52,263 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:07:52,263 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_939860367_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,263 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499, snapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 07:07:52,272 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:52,285 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:52,307 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,308 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,308 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,308 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,309 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,309 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,309 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,378 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop-1560195379056931119.jar 2023-07-24 07:07:52,379 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,379 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,379 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,380 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,380 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,380 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:52,380 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:07:52,381 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:07:52,381 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:07:52,382 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:07:52,382 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:07:52,382 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:07:52,383 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:07:52,383 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:07:52,383 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:07:52,384 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:07:52,384 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:52,384 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:52,385 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:52,385 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:52,385 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:52,386 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:52,386 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:53,093 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:07:53,687 WARN [Listener at jenkins-hbase4.apache.org/46687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:07:53,690 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 07:07:53,692 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 07:07:53,810 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:53,810 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:54,026 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0005_000001 (auth:SIMPLE) 2023-07-24 07:07:59,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:01,950 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:05,897 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:07,010 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:08:07,011 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:08:07,049 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,049 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:08:07,049 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:08:07,050 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,050 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 07:08:07,050 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 07:08:07,051 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,051 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 07:08:07,051 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182472233/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 07:08:07,061 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 07:08:07,069 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182487069"}]},"ts":"1690182487069"} 2023-07-24 07:08:07,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 07:08:07,073 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 07:08:07,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e85d63016f54f16b2f3c954a23230f58, UNASSIGN}] 2023-07-24 07:08:07,078 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e85d63016f54f16b2f3c954a23230f58, UNASSIGN 2023-07-24 07:08:07,079 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e85d63016f54f16b2f3c954a23230f58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:07,079 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690182487079"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182487079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182487079"}]},"ts":"1690182487079"} 2023-07-24 07:08:07,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure e85d63016f54f16b2f3c954a23230f58, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:08:07,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 07:08:07,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:08:07,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e85d63016f54f16b2f3c954a23230f58, disabling compactions & flushes 2023-07-24 07:08:07,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:08:07,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:08:07,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. after waiting 0 ms 2023-07-24 07:08:07,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:08:07,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 07:08:07,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:07,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58. 2023-07-24 07:08:07,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e85d63016f54f16b2f3c954a23230f58: 2023-07-24 07:08:07,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:08:07,271 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e85d63016f54f16b2f3c954a23230f58, regionState=CLOSED 2023-07-24 07:08:07,271 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690182487271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182487271"}]},"ts":"1690182487271"} 2023-07-24 07:08:07,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 07:08:07,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure e85d63016f54f16b2f3c954a23230f58, server=jenkins-hbase4.apache.org,33211,1690182392248 in 196 msec 2023-07-24 07:08:07,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 07:08:07,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e85d63016f54f16b2f3c954a23230f58, UNASSIGN in 210 msec 2023-07-24 07:08:07,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182487288"}]},"ts":"1690182487288"} 2023-07-24 07:08:07,290 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 07:08:07,292 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 07:08:07,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 231 msec 2023-07-24 07:08:07,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 07:08:07,370 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 07:08:07,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,378 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,380 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,381 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,385 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,385 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,385 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,385 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 07:08:07,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 07:08:07,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 07:08:07,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 07:08:07,387 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,387 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:07,387 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,387 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:07,387 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,387 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,387 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:07,387 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:07,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:07,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 07:08:07,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:07,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:07,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:07,397 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:08:07,401 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:08:07,401 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:08:07,403 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/recovered.edits] 2023-07-24 07:08:07,403 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/recovered.edits] 2023-07-24 07:08:07,409 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/4bc1f8da3319404b81fda2fccca886e3.a93b4ba5d0297f73c11da44ebc1f0e58 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/4bc1f8da3319404b81fda2fccca886e3.a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:08:07,409 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf/971823d1dd0b4247a3d0b1ff6384678b to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/cf/971823d1dd0b4247a3d0b1ff6384678b 2023-07-24 07:08:07,412 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/recovered.edits] 2023-07-24 07:08:07,414 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/971823d1dd0b4247a3d0b1ff6384678b.e6c7ddd1d8cb189a3335d7fc97b16cb5 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/cf/971823d1dd0b4247a3d0b1ff6384678b.e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:08:07,414 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/recovered.edits/8.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5/recovered.edits/8.seqid 2023-07-24 07:08:07,415 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6c7ddd1d8cb189a3335d7fc97b16cb5 2023-07-24 07:08:07,420 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf/4bc1f8da3319404b81fda2fccca886e3 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/cf/4bc1f8da3319404b81fda2fccca886e3 2023-07-24 07:08:07,420 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/recovered.edits/12.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58/recovered.edits/12.seqid 2023-07-24 07:08:07,421 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e85d63016f54f16b2f3c954a23230f58 2023-07-24 07:08:07,424 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/recovered.edits/8.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58/recovered.edits/8.seqid 2023-07-24 07:08:07,424 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a93b4ba5d0297f73c11da44ebc1f0e58 2023-07-24 07:08:07,425 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 07:08:07,427 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,445 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 07:08:07,466 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 07:08:07,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 07:08:07,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182487469"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:07,483 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 07:08:07,483 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e85d63016f54f16b2f3c954a23230f58, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182470111.e85d63016f54f16b2f3c954a23230f58.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 07:08:07,483 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 07:08:07,483 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182487483"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:07,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 07:08:07,490 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 07:08:07,493 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:07,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 121 msec 2023-07-24 07:08:07,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 07:08:07,691 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 07:08:07,692 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:07,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:07,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:07,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 07:08:07,699 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182487699"}]},"ts":"1690182487699"} 2023-07-24 07:08:07,700 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 07:08:07,707 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 07:08:07,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b81c67cef0f6a3296d01e47cb85e0b8, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5f44f730cf42ab587cae307e0596f39a, UNASSIGN}] 2023-07-24 07:08:07,709 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5f44f730cf42ab587cae307e0596f39a, UNASSIGN 2023-07-24 07:08:07,711 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b81c67cef0f6a3296d01e47cb85e0b8, UNASSIGN 2023-07-24 07:08:07,712 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=5f44f730cf42ab587cae307e0596f39a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:07,712 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9b81c67cef0f6a3296d01e47cb85e0b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:07,712 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182487712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182487712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182487712"}]},"ts":"1690182487712"} 2023-07-24 07:08:07,712 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182487712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182487712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182487712"}]},"ts":"1690182487712"} 2023-07-24 07:08:07,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9b81c67cef0f6a3296d01e47cb85e0b8, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:08:07,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 5f44f730cf42ab587cae307e0596f39a, server=jenkins-hbase4.apache.org,43589,1690182392179}] 2023-07-24 07:08:07,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 07:08:07,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:08:07,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b81c67cef0f6a3296d01e47cb85e0b8, disabling compactions & flushes 2023-07-24 07:08:07,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:08:07,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:08:07,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. after waiting 0 ms 2023-07-24 07:08:07,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:08:07,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:08:07,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f44f730cf42ab587cae307e0596f39a, disabling compactions & flushes 2023-07-24 07:08:07,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:08:07,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:08:07,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. after waiting 0 ms 2023-07-24 07:08:07,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:08:07,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:07,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:07,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8. 2023-07-24 07:08:07,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b81c67cef0f6a3296d01e47cb85e0b8: 2023-07-24 07:08:07,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:07,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:08:07,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:07,961 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9b81c67cef0f6a3296d01e47cb85e0b8, regionState=CLOSED 2023-07-24 07:08:07,967 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182487961"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182487961"}]},"ts":"1690182487961"} 2023-07-24 07:08:07,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a. 2023-07-24 07:08:07,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f44f730cf42ab587cae307e0596f39a: 2023-07-24 07:08:07,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:08:07,970 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=5f44f730cf42ab587cae307e0596f39a, regionState=CLOSED 2023-07-24 07:08:07,970 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182487970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182487970"}]},"ts":"1690182487970"} 2023-07-24 07:08:07,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-24 07:08:07,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9b81c67cef0f6a3296d01e47cb85e0b8, server=jenkins-hbase4.apache.org,44253,1690182392310 in 255 msec 2023-07-24 07:08:07,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b81c67cef0f6a3296d01e47cb85e0b8, UNASSIGN in 264 msec 2023-07-24 07:08:07,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-24 07:08:07,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 5f44f730cf42ab587cae307e0596f39a, server=jenkins-hbase4.apache.org,43589,1690182392179 in 255 msec 2023-07-24 07:08:07,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-24 07:08:07,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5f44f730cf42ab587cae307e0596f39a, UNASSIGN in 267 msec 2023-07-24 07:08:07,978 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182487978"}]},"ts":"1690182487978"} 2023-07-24 07:08:07,980 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 07:08:07,981 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 07:08:07,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 289 msec 2023-07-24 07:08:08,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 07:08:08,001 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 07:08:08,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,006 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,007 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,009 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,012 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,013 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,013 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,013 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,013 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 07:08:08,013 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 07:08:08,014 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 07:08:08,014 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:08:08,014 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:08:08,017 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:08,017 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-24 07:08:08,017 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:08:08,017 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,018 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:08,017 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,018 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,018 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:08,018 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:08,019 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/recovered.edits] 2023-07-24 07:08:08,020 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/recovered.edits] 2023-07-24 07:08:08,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 07:08:08,026 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf/8dc8d8f202084451bc2d2864910448f1 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/cf/8dc8d8f202084451bc2d2864910448f1 2023-07-24 07:08:08,029 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf/ba6b83e6796e4a0aaa58266f94fad4b7 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/cf/ba6b83e6796e4a0aaa58266f94fad4b7 2023-07-24 07:08:08,033 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a/recovered.edits/9.seqid 2023-07-24 07:08:08,034 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5f44f730cf42ab587cae307e0596f39a 2023-07-24 07:08:08,035 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8/recovered.edits/9.seqid 2023-07-24 07:08:08,036 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b81c67cef0f6a3296d01e47cb85e0b8 2023-07-24 07:08:08,036 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 07:08:08,045 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,047 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 07:08:08,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 07:08:08,065 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,065 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 07:08:08,065 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182488065"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:08,065 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182488065"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:08,067 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:08:08,067 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9b81c67cef0f6a3296d01e47cb85e0b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690182467790.9b81c67cef0f6a3296d01e47cb85e0b8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5f44f730cf42ab587cae307e0596f39a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182467790.5f44f730cf42ab587cae307e0596f39a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:08:08,067 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 07:08:08,067 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182488067"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:08,069 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 07:08:08,079 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 77 msec 2023-07-24 07:08:08,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 07:08:08,124 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 07:08:08,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 07:08:08,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 07:08:08,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:08,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 07:08:08,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:08,222 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 749) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_832908776_1 at /127.0.0.1:56500 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_832908776_1 at /127.0.0.1:57798 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:54028 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3944 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:39873 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:56522 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:57824 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=446 (was 388) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 183), AvailableMemoryMB=5645 (was 5939) 2023-07-24 07:08:08,222 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 07:08:08,250 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=446, ProcessCount=181, AvailableMemoryMB=5635 2023-07-24 07:08:08,251 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 07:08:08,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:08:08,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:08,259 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:08:08,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 07:08:08,260 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:08:08,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:08,263 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,263 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,264 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84 empty. 2023-07-24 07:08:08,264 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d empty. 2023-07-24 07:08:08,264 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,265 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,265 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 07:08:08,304 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 07:08:08,307 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8ebef684f05cf86b032456d822cf3a84, NAME => 'testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:08:08,307 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 197ccf1cf6d03e274320a663359c5c4d, NAME => 'testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:08:08,343 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:08,344 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 197ccf1cf6d03e274320a663359c5c4d, disabling compactions & flushes 2023-07-24 07:08:08,344 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:08,344 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:08,344 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. after waiting 0 ms 2023-07-24 07:08:08,344 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:08,344 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:08,344 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 197ccf1cf6d03e274320a663359c5c4d: 2023-07-24 07:08:08,344 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:08,344 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8ebef684f05cf86b032456d822cf3a84, disabling compactions & flushes 2023-07-24 07:08:08,345 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:08,345 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:08,345 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. after waiting 0 ms 2023-07-24 07:08:08,345 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:08,345 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:08,345 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8ebef684f05cf86b032456d822cf3a84: 2023-07-24 07:08:08,347 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:08:08,348 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182488348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182488348"}]},"ts":"1690182488348"} 2023-07-24 07:08:08,349 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182488348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182488348"}]},"ts":"1690182488348"} 2023-07-24 07:08:08,350 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:08:08,351 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:08:08,351 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182488351"}]},"ts":"1690182488351"} 2023-07-24 07:08:08,353 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 07:08:08,356 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:08:08,357 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:08:08,357 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:08:08,357 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:08:08,357 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:08:08,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ebef684f05cf86b032456d822cf3a84, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=197ccf1cf6d03e274320a663359c5c4d, ASSIGN}] 2023-07-24 07:08:08,360 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=197ccf1cf6d03e274320a663359c5c4d, ASSIGN 2023-07-24 07:08:08,360 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ebef684f05cf86b032456d822cf3a84, ASSIGN 2023-07-24 07:08:08,361 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=197ccf1cf6d03e274320a663359c5c4d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44253,1690182392310; forceNewPlan=false, retain=false 2023-07-24 07:08:08,361 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ebef684f05cf86b032456d822cf3a84, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33211,1690182392248; forceNewPlan=false, retain=false 2023-07-24 07:08:08,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:08,511 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:08:08,515 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=197ccf1cf6d03e274320a663359c5c4d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,515 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182488515"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182488515"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182488515"}]},"ts":"1690182488515"} 2023-07-24 07:08:08,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 197ccf1cf6d03e274320a663359c5c4d, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:08:08,517 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8ebef684f05cf86b032456d822cf3a84, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,518 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182488517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182488517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182488517"}]},"ts":"1690182488517"} 2023-07-24 07:08:08,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 8ebef684f05cf86b032456d822cf3a84, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:08:08,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:08,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:08,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 197ccf1cf6d03e274320a663359c5c4d, NAME => 'testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:08:08,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. service=AccessControlService 2023-07-24 07:08:08,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:08:08,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:08,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:08,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ebef684f05cf86b032456d822cf3a84, NAME => 'testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:08:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. service=AccessControlService 2023-07-24 07:08:08,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:08:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,679 INFO [StoreOpener-197ccf1cf6d03e274320a663359c5c4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,680 INFO [StoreOpener-8ebef684f05cf86b032456d822cf3a84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,681 DEBUG [StoreOpener-197ccf1cf6d03e274320a663359c5c4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf 2023-07-24 07:08:08,681 DEBUG [StoreOpener-197ccf1cf6d03e274320a663359c5c4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf 2023-07-24 07:08:08,681 INFO [StoreOpener-197ccf1cf6d03e274320a663359c5c4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 197ccf1cf6d03e274320a663359c5c4d columnFamilyName cf 2023-07-24 07:08:08,682 INFO [StoreOpener-197ccf1cf6d03e274320a663359c5c4d-1] regionserver.HStore(310): Store=197ccf1cf6d03e274320a663359c5c4d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:08:08,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,687 DEBUG [StoreOpener-8ebef684f05cf86b032456d822cf3a84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf 2023-07-24 07:08:08,687 DEBUG [StoreOpener-8ebef684f05cf86b032456d822cf3a84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf 2023-07-24 07:08:08,688 INFO [StoreOpener-8ebef684f05cf86b032456d822cf3a84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ebef684f05cf86b032456d822cf3a84 columnFamilyName cf 2023-07-24 07:08:08,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:08,690 INFO [StoreOpener-8ebef684f05cf86b032456d822cf3a84-1] regionserver.HStore(310): Store=8ebef684f05cf86b032456d822cf3a84/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:08:08,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:08:08,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 197ccf1cf6d03e274320a663359c5c4d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72670201, jitterRate=0.08287037909030914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:08:08,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 197ccf1cf6d03e274320a663359c5c4d: 2023-07-24 07:08:08,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d., pid=93, masterSystemTime=1690182488673 2023-07-24 07:08:08,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:08,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:08,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:08,700 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=197ccf1cf6d03e274320a663359c5c4d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,700 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182488700"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182488700"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182488700"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182488700"}]},"ts":"1690182488700"} 2023-07-24 07:08:08,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:08:08,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8ebef684f05cf86b032456d822cf3a84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74143980, jitterRate=0.10483139753341675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:08:08,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8ebef684f05cf86b032456d822cf3a84: 2023-07-24 07:08:08,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84., pid=94, masterSystemTime=1690182488675 2023-07-24 07:08:08,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-24 07:08:08,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 197ccf1cf6d03e274320a663359c5c4d, server=jenkins-hbase4.apache.org,44253,1690182392310 in 185 msec 2023-07-24 07:08:08,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:08,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:08,708 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8ebef684f05cf86b032456d822cf3a84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,708 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182488708"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182488708"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182488708"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182488708"}]},"ts":"1690182488708"} 2023-07-24 07:08:08,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=197ccf1cf6d03e274320a663359c5c4d, ASSIGN in 350 msec 2023-07-24 07:08:08,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-24 07:08:08,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 8ebef684f05cf86b032456d822cf3a84, server=jenkins-hbase4.apache.org,33211,1690182392248 in 191 msec 2023-07-24 07:08:08,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-24 07:08:08,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ebef684f05cf86b032456d822cf3a84, ASSIGN in 354 msec 2023-07-24 07:08:08,719 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:08:08,719 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182488719"}]},"ts":"1690182488719"} 2023-07-24 07:08:08,721 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 07:08:08,727 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:08:08,727 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 07:08:08,729 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:08:08,733 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:08,733 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:08,733 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:08,733 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:08,734 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:08,734 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:08,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:08,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:08,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 482 msec 2023-07-24 07:08:08,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:08,865 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 07:08:08,866 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 07:08:08,866 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:08,871 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 07:08:08,871 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:08,871 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-24 07:08:08,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:08,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182488875 (current time:1690182488875). 2023-07-24 07:08:08,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:08:08,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x402fa427 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:08,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d5cfe4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:08,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:08,895 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:08,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x402fa427 to 127.0.0.1:64453 2023-07-24 07:08:08,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:08,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x2875cdeb to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:08,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15c65a5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:08,915 DEBUG [hconnection-0x5fa2703d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:08,916 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:08,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:08,925 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:08,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2875cdeb to 127.0.0.1:64453 2023-07-24 07:08:08,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:08,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:08:08,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:08:08,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:08,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:08,934 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:08,935 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690183088935 2023-07-24 07:08:08,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:08,935 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:08,937 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:08:08,937 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:08:08,939 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:08,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:08,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-24 07:08:08,945 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:08,946 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690183088946 2023-07-24 07:08:08,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,960 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 07:08:08,960 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:08,962 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 07:08:08,962 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 07:08:08,962 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,962 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:08,966 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:08,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:08,966 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:08,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:08,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:08,967 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:08,967 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,967 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,967 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:08:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 07:08:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 07:08:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:08,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:08,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,969 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:08,969 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:08,969 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:08,969 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,972 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:08,972 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:08,972 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:08,970 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:08,972 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:08,972 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:08,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 07:08:08,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:08,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,976 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:08,976 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:08,977 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:08,977 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:08,977 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:08,978 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,978 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,978 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:08,978 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,978 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:08,978 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,978 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:08,979 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,979 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:08,979 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,979 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:08,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:08,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:08,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:08,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 07:08:08,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2634c29b[Count = 1] remaining members to acquire global barrier 2023-07-24 07:08:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:08,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 07:08:08,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2634c29b[Count = 0] remaining members to acquire global barrier 2023-07-24 07:08:08,985 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 07:08:08,985 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:08,988 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:08,988 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:08:08,990 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:08,991 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:08,991 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:08,991 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:08:08,991 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:08,992 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:08,992 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:09,004 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:09,006 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:09,007 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:09,006 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:09,007 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. started... 2023-07-24 07:08:09,007 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. started... 2023-07-24 07:08:09,008 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ebef684f05cf86b032456d822cf3a84: 2023-07-24 07:08:09,009 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,009 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:09,009 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:08:09,011 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 197ccf1cf6d03e274320a663359c5c4d: 2023-07-24 07:08:09,011 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,011 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:09,011 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:08:09,037 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:09,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:09,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:09,039 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:08:09,048 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. completed. 2023-07-24 07:08:09,048 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. completed. 2023-07-24 07:08:09,048 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:09,048 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:09,048 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,048 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:08:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:08:09,051 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,051 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:09,051 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:09,051 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:09,053 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:09,053 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,053 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:09,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:09,053 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:09,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:09,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:08:09,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 07:08:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44253,1690182392310': 2023-07-24 07:08:09,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 07:08:09,061 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 07:08:09,061 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:08:09,061 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:08:09,061 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,061 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:08:09,063 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,063 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:09,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,063 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,063 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,063 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,064 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:09,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,064 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,064 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,065 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,065 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:09,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,067 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,068 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,068 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,072 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,072 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,072 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,073 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,072 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,072 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,072 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,073 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,073 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:09,073 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,075 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,224 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 07:08:09,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,224 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690182488935Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690182489073 (+138 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690182489073Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690182489079 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690182489103 (+24 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690182489224 (+121 ms) 2023-07-24 07:08:09,229 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:09,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 292 msec 2023-07-24 07:08:09,239 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:09,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:09,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:08:09,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33211] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:08:09,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44253] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:08:09,257 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:09,257 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:09,257 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:09,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:09,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182489267 (current time:1690182489268). 2023-07-24 07:08:09,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:08:09,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x7c3da50f to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:09,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3052012d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:09,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:09,281 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:09,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c3da50f to 127.0.0.1:64453 2023-07-24 07:08:09,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:09,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x520a46aa to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:09,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@430e9439, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:09,295 DEBUG [hconnection-0x6375be1c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:09,298 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:09,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:09,303 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:09,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x520a46aa to 127.0.0.1:64453 2023-07-24 07:08:09,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:09,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:08:09,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:08:09,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:09,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:09,309 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:09,309 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690183089309 2023-07-24 07:08:09,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:09,309 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:09,311 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:08:09,312 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:08:09,315 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:09,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:09,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-24 07:08:09,321 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:09,322 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690183089322 2023-07-24 07:08:09,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,337 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 07:08:09,337 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:09,339 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 07:08:09,339 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 07:08:09,340 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,340 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,342 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,342 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,342 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,342 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,343 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,343 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,343 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,343 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 07:08:09,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,344 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:09,344 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:09,344 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:09,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,344 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:09,344 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:09,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,345 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:09,345 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:09,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:09,352 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:09,356 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:09,357 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:09,357 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:09,358 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,358 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:09,359 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,359 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,360 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,360 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,360 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:09,360 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:09,360 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:09,360 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,360 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:09,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:09,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 07:08:09,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@441078ec[Count = 1] remaining members to acquire global barrier 2023-07-24 07:08:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:09,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 07:08:09,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@441078ec[Count = 0] remaining members to acquire global barrier 2023-07-24 07:08:09,365 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 07:08:09,365 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,369 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,370 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,369 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:09,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:09,370 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:09,370 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:09,370 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. started... 2023-07-24 07:08:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:08:09,370 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,371 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:08:09,371 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 197ccf1cf6d03e274320a663359c5c4d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 07:08:09,372 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:09,372 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:09,372 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:09,379 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:09,380 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:09,380 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:09,380 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. started... 2023-07-24 07:08:09,380 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8ebef684f05cf86b032456d822cf3a84 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 07:08:09,415 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:09,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:09,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:09,421 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:08:09,424 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/.tmp/cf/e0e85f909c3644a1b9c176f0f015024a 2023-07-24 07:08:09,426 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/.tmp/cf/cf08560e1db44e999d0445369267eaad 2023-07-24 07:08:09,434 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/.tmp/cf/e0e85f909c3644a1b9c176f0f015024a as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf/e0e85f909c3644a1b9c176f0f015024a 2023-07-24 07:08:09,435 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/.tmp/cf/cf08560e1db44e999d0445369267eaad as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf/cf08560e1db44e999d0445369267eaad 2023-07-24 07:08:09,442 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf/e0e85f909c3644a1b9c176f0f015024a, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 07:08:09,442 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf/cf08560e1db44e999d0445369267eaad, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 07:08:09,443 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 197ccf1cf6d03e274320a663359c5c4d in 72ms, sequenceid=6, compaction requested=false 2023-07-24 07:08:09,443 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 07:08:09,443 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8ebef684f05cf86b032456d822cf3a84 in 63ms, sequenceid=6, compaction requested=false 2023-07-24 07:08:09,443 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 07:08:09,445 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 197ccf1cf6d03e274320a663359c5c4d: 2023-07-24 07:08:09,447 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ebef684f05cf86b032456d822cf3a84: 2023-07-24 07:08:09,447 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,447 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,447 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:09,447 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:09,447 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf/e0e85f909c3644a1b9c176f0f015024a] hfiles 2023-07-24 07:08:09,448 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf/cf08560e1db44e999d0445369267eaad] hfiles 2023-07-24 07:08:09,448 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf/cf08560e1db44e999d0445369267eaad for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,448 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf/e0e85f909c3644a1b9c176f0f015024a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,501 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. completed. 2023-07-24 07:08:09,501 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:09,501 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:09,501 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:09,501 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,502 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:09,502 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:08:09,503 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. completed. 2023-07-24 07:08:09,503 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:09,503 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:09,503 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:09,503 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,503 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:09,503 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:08:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:09,505 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:09,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:09,507 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:08:09,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 07:08:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:09,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44253,1690182392310': 2023-07-24 07:08:09,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 07:08:09,522 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 07:08:09,522 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:08:09,522 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:08:09,522 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,522 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:08:09,525 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,525 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:09,525 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,525 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,525 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,525 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,526 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:09,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,526 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:09,527 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,528 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,530 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,531 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,531 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:09,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:09,534 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,535 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:09,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:09,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,535 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,537 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,537 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:09,537 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,537 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:09,537 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:09,537 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,537 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:09,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:09,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,621 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:09,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:09,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:09,623 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:08:09,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 07:08:09,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,680 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690182489310Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690182489535 (+225 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690182489537 (+2 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690182489547 (+10 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690182489591 (+44 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690182489680 (+89 ms) 2023-07-24 07:08:09,685 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:09,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 374 msec 2023-07-24 07:08:09,923 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:09,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:09,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:08:09,925 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925 2023-07-24 07:08:09,925 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42803, tgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925, rawTgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925, srcFsUri=hdfs://localhost:42803, srcDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:08:09,961 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:08:09,961 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1728465313_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:09,961 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499, snapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 07:08:09,968 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:10,017 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,017 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,017 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,018 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,018 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,018 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,018 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,108 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop-5919210515475128239.jar 2023-07-24 07:08:10,109 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,109 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,110 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,110 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,111 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,111 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:10,112 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:08:10,112 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:08:10,113 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:08:10,114 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:08:10,114 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:08:10,115 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:08:10,115 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:08:10,116 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:08:10,116 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:08:10,117 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:08:10,118 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:10,118 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:10,119 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:10,119 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:10,119 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:10,120 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:10,121 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:10,986 WARN [Listener at jenkins-hbase4.apache.org/46687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:08:10,989 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 07:08:12,027 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:12,027 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:12,031 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:12,313 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0006_000001 (auth:SIMPLE) 2023-07-24 07:08:12,938 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:08:18,231 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0006_000001 (auth:SIMPLE) 2023-07-24 07:08:21,238 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:08:21,241 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:08:21,253 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:21,253 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:08:21,254 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:08:21,254 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:21,255 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 07:08:21,255 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 07:08:21,255 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:21,255 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 07:08:21,255 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182489925/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 07:08:21,261 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 07:08:21,268 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182501268"}]},"ts":"1690182501268"} 2023-07-24 07:08:21,269 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 07:08:21,272 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 07:08:21,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ebef684f05cf86b032456d822cf3a84, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=197ccf1cf6d03e274320a663359c5c4d, UNASSIGN}] 2023-07-24 07:08:21,278 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ebef684f05cf86b032456d822cf3a84, UNASSIGN 2023-07-24 07:08:21,278 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=197ccf1cf6d03e274320a663359c5c4d, UNASSIGN 2023-07-24 07:08:21,284 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8ebef684f05cf86b032456d822cf3a84, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:21,284 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=197ccf1cf6d03e274320a663359c5c4d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:21,284 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182501284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182501284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182501284"}]},"ts":"1690182501284"} 2023-07-24 07:08:21,284 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182501284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182501284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182501284"}]},"ts":"1690182501284"} 2023-07-24 07:08:21,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 8ebef684f05cf86b032456d822cf3a84, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:08:21,287 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 197ccf1cf6d03e274320a663359c5c4d, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:08:21,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 07:08:21,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:21,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8ebef684f05cf86b032456d822cf3a84, disabling compactions & flushes 2023-07-24 07:08:21,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:21,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:21,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. after waiting 0 ms 2023-07-24 07:08:21,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:21,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:21,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 197ccf1cf6d03e274320a663359c5c4d, disabling compactions & flushes 2023-07-24 07:08:21,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:21,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:21,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. after waiting 0 ms 2023-07-24 07:08:21,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:21,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:21,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:21,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:21,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d. 2023-07-24 07:08:21,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 197ccf1cf6d03e274320a663359c5c4d: 2023-07-24 07:08:21,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:21,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84. 2023-07-24 07:08:21,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8ebef684f05cf86b032456d822cf3a84: 2023-07-24 07:08:21,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:21,463 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=197ccf1cf6d03e274320a663359c5c4d, regionState=CLOSED 2023-07-24 07:08:21,463 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182501463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182501463"}]},"ts":"1690182501463"} 2023-07-24 07:08:21,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:21,464 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8ebef684f05cf86b032456d822cf3a84, regionState=CLOSED 2023-07-24 07:08:21,464 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182501464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182501464"}]},"ts":"1690182501464"} 2023-07-24 07:08:21,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-24 07:08:21,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 197ccf1cf6d03e274320a663359c5c4d, server=jenkins-hbase4.apache.org,44253,1690182392310 in 178 msec 2023-07-24 07:08:21,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-24 07:08:21,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 8ebef684f05cf86b032456d822cf3a84, server=jenkins-hbase4.apache.org,33211,1690182392248 in 179 msec 2023-07-24 07:08:21,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=197ccf1cf6d03e274320a663359c5c4d, UNASSIGN in 193 msec 2023-07-24 07:08:21,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-24 07:08:21,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ebef684f05cf86b032456d822cf3a84, UNASSIGN in 194 msec 2023-07-24 07:08:21,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182501469"}]},"ts":"1690182501469"} 2023-07-24 07:08:21,470 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 07:08:21,474 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 07:08:21,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 214 msec 2023-07-24 07:08:21,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 07:08:21,573 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 07:08:21,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,579 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,580 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,581 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,586 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:21,586 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:21,588 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/recovered.edits] 2023-07-24 07:08:21,588 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/recovered.edits] 2023-07-24 07:08:21,592 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,592 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,592 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,592 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:21,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:21,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:21,597 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:21,598 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf/e0e85f909c3644a1b9c176f0f015024a to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/cf/e0e85f909c3644a1b9c176f0f015024a 2023-07-24 07:08:21,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 07:08:21,598 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:08:21,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 07:08:21,598 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:08:21,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 07:08:21,598 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:08:21,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 07:08:21,598 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:08:21,599 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf/cf08560e1db44e999d0445369267eaad to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/cf/cf08560e1db44e999d0445369267eaad 2023-07-24 07:08:21,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 07:08:21,604 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d/recovered.edits/9.seqid 2023-07-24 07:08:21,605 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/197ccf1cf6d03e274320a663359c5c4d 2023-07-24 07:08:21,606 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84/recovered.edits/9.seqid 2023-07-24 07:08:21,606 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ebef684f05cf86b032456d822cf3a84 2023-07-24 07:08:21,606 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 07:08:21,609 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,612 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 07:08:21,614 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 07:08:21,615 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,615 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 07:08:21,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182501615"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:21,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182501615"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:21,617 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:08:21,617 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8ebef684f05cf86b032456d822cf3a84, NAME => 'testtb-testEmptyExportFileSystemState,,1690182488252.8ebef684f05cf86b032456d822cf3a84.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 197ccf1cf6d03e274320a663359c5c4d, NAME => 'testtb-testEmptyExportFileSystemState,1,1690182488252.197ccf1cf6d03e274320a663359c5c4d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:08:21,618 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 07:08:21,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182501618"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:21,628 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 07:08:21,631 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:21,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 57 msec 2023-07-24 07:08:21,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 07:08:21,701 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 07:08:21,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 07:08:21,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:21,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 07:08:21,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:21,752 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:50616 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:40881 from appattempt_1690182400023_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:53250 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:41063 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4596 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:34025 from appattempt_1690182400023_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:47502 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-455133827_1 at /127.0.0.1:55018 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-455133827_1 at /127.0.0.1:34946 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=451 (was 446) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 181), AvailableMemoryMB=4909 (was 5635) 2023-07-24 07:08:21,752 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-24 07:08:21,782 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=451, ProcessCount=178, AvailableMemoryMB=4906 2023-07-24 07:08:21,783 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-24 07:08:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:08:21,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:21,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:08:21,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 07:08:21,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:21,794 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:08:21,799 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:21,799 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55 2023-07-24 07:08:21,800 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3 empty. 2023-07-24 07:08:21,801 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55 empty. 2023-07-24 07:08:21,801 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:21,801 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55 2023-07-24 07:08:21,801 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 07:08:21,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:22,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:22,230 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 07:08:22,240 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3756b46a809b4ca80a914d903b43f6d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:08:22,253 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 776696768bad16766570b31d7201fb55, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp 2023-07-24 07:08:22,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:22,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 3756b46a809b4ca80a914d903b43f6d3, disabling compactions & flushes 2023-07-24 07:08:22,319 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:22,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:22,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. after waiting 0 ms 2023-07-24 07:08:22,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:22,319 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:22,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 3756b46a809b4ca80a914d903b43f6d3: 2023-07-24 07:08:22,329 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:22,329 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 776696768bad16766570b31d7201fb55, disabling compactions & flushes 2023-07-24 07:08:22,329 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:22,329 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:22,329 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. after waiting 0 ms 2023-07-24 07:08:22,329 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:22,329 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:22,329 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 776696768bad16766570b31d7201fb55: 2023-07-24 07:08:22,334 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:08:22,335 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182502335"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182502335"}]},"ts":"1690182502335"} 2023-07-24 07:08:22,335 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182502335"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182502335"}]},"ts":"1690182502335"} 2023-07-24 07:08:22,338 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:08:22,340 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:08:22,340 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182502340"}]},"ts":"1690182502340"} 2023-07-24 07:08:22,341 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 07:08:22,345 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:08:22,347 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:08:22,347 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:08:22,347 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:08:22,347 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:08:22,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3756b46a809b4ca80a914d903b43f6d3, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=776696768bad16766570b31d7201fb55, ASSIGN}] 2023-07-24 07:08:22,350 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=776696768bad16766570b31d7201fb55, ASSIGN 2023-07-24 07:08:22,350 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3756b46a809b4ca80a914d903b43f6d3, ASSIGN 2023-07-24 07:08:22,351 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=776696768bad16766570b31d7201fb55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33211,1690182392248; forceNewPlan=false, retain=false 2023-07-24 07:08:22,351 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3756b46a809b4ca80a914d903b43f6d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44253,1690182392310; forceNewPlan=false, retain=false 2023-07-24 07:08:22,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:22,501 INFO [jenkins-hbase4:38165] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:08:22,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=776696768bad16766570b31d7201fb55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:22,505 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3756b46a809b4ca80a914d903b43f6d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:22,505 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182502505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182502505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182502505"}]},"ts":"1690182502505"} 2023-07-24 07:08:22,505 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182502505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182502505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182502505"}]},"ts":"1690182502505"} 2023-07-24 07:08:22,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 776696768bad16766570b31d7201fb55, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:08:22,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 3756b46a809b4ca80a914d903b43f6d3, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:08:22,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:22,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3756b46a809b4ca80a914d903b43f6d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:08:22,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. service=AccessControlService 2023-07-24 07:08:22,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:08:22,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:22,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:22,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:22,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:22,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:22,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 776696768bad16766570b31d7201fb55, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:08:22,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. service=AccessControlService 2023-07-24 07:08:22,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:08:22,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 776696768bad16766570b31d7201fb55 2023-07-24 07:08:22,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:22,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 776696768bad16766570b31d7201fb55 2023-07-24 07:08:22,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 776696768bad16766570b31d7201fb55 2023-07-24 07:08:22,667 INFO [StoreOpener-3756b46a809b4ca80a914d903b43f6d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:22,670 DEBUG [StoreOpener-3756b46a809b4ca80a914d903b43f6d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf 2023-07-24 07:08:22,670 DEBUG [StoreOpener-3756b46a809b4ca80a914d903b43f6d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf 2023-07-24 07:08:22,670 INFO [StoreOpener-3756b46a809b4ca80a914d903b43f6d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3756b46a809b4ca80a914d903b43f6d3 columnFamilyName cf 2023-07-24 07:08:22,672 INFO [StoreOpener-3756b46a809b4ca80a914d903b43f6d3-1] regionserver.HStore(310): Store=3756b46a809b4ca80a914d903b43f6d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:08:22,675 INFO [StoreOpener-776696768bad16766570b31d7201fb55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 776696768bad16766570b31d7201fb55 2023-07-24 07:08:22,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:22,677 DEBUG [StoreOpener-776696768bad16766570b31d7201fb55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf 2023-07-24 07:08:22,677 DEBUG [StoreOpener-776696768bad16766570b31d7201fb55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf 2023-07-24 07:08:22,678 INFO [StoreOpener-776696768bad16766570b31d7201fb55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 776696768bad16766570b31d7201fb55 columnFamilyName cf 2023-07-24 07:08:22,679 INFO [StoreOpener-776696768bad16766570b31d7201fb55-1] regionserver.HStore(310): Store=776696768bad16766570b31d7201fb55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:08:22,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55 2023-07-24 07:08:22,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55 2023-07-24 07:08:22,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:22,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 776696768bad16766570b31d7201fb55 2023-07-24 07:08:22,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:08:22,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:08:22,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 776696768bad16766570b31d7201fb55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72413480, jitterRate=0.07904493808746338}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:08:22,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 776696768bad16766570b31d7201fb55: 2023-07-24 07:08:22,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3756b46a809b4ca80a914d903b43f6d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60179659, jitterRate=-0.10325320065021515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:08:22,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3756b46a809b4ca80a914d903b43f6d3: 2023-07-24 07:08:22,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55., pid=108, masterSystemTime=1690182502659 2023-07-24 07:08:22,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3., pid=109, masterSystemTime=1690182502660 2023-07-24 07:08:22,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:22,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:22,701 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=776696768bad16766570b31d7201fb55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:22,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:22,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:22,701 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182502701"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182502701"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182502701"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182502701"}]},"ts":"1690182502701"} 2023-07-24 07:08:22,702 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3756b46a809b4ca80a914d903b43f6d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:22,702 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182502702"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182502702"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182502702"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182502702"}]},"ts":"1690182502702"} 2023-07-24 07:08:22,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 07:08:22,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 776696768bad16766570b31d7201fb55, server=jenkins-hbase4.apache.org,33211,1690182392248 in 196 msec 2023-07-24 07:08:22,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 07:08:22,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 3756b46a809b4ca80a914d903b43f6d3, server=jenkins-hbase4.apache.org,44253,1690182392310 in 196 msec 2023-07-24 07:08:22,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=776696768bad16766570b31d7201fb55, ASSIGN in 358 msec 2023-07-24 07:08:22,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 07:08:22,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3756b46a809b4ca80a914d903b43f6d3, ASSIGN in 359 msec 2023-07-24 07:08:22,709 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:08:22,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182502709"}]},"ts":"1690182502709"} 2023-07-24 07:08:22,710 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 07:08:22,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:08:22,713 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 07:08:22,715 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 07:08:22,716 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:22,716 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:22,716 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:22,716 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:22,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:22,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:22,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:22,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:22,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 938 msec 2023-07-24 07:08:22,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:22,899 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 07:08:22,899 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-24 07:08:22,899 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:22,917 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-24 07:08:22,918 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:22,918 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-24 07:08:22,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:22,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182502921 (current time:1690182502921). 2023-07-24 07:08:22,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:08:22,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x7969a094 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:22,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ad4081a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:22,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:22,960 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:22,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7969a094 to 127.0.0.1:64453 2023-07-24 07:08:22,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:22,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x6d103af3 to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:22,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59c95ac5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:23,071 DEBUG [hconnection-0x13970d3e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:23,084 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:23,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:23,099 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:23,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d103af3 to 127.0.0.1:64453 2023-07-24 07:08:23,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:23,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 07:08:23,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:08:23,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:23,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:23,116 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:23,117 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690183103117 2023-07-24 07:08:23,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:23,118 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,118 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:08:23,120 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:08:23,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:23,128 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:23,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 22 msec 2023-07-24 07:08:23,131 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:23,132 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690183103132 2023-07-24 07:08:23,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,154 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 07:08:23,154 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:23,156 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 07:08:23,156 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 07:08:23,157 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,157 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,162 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,162 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,162 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,162 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,162 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,162 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,163 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,163 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:08:23,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:23,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,164 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:23,164 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:23,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:23,167 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:23,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,167 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:23,167 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:23,167 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:23,168 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:23,168 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:23,168 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:23,168 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:23,170 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:23,170 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:23,170 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:23,170 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:23,177 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,177 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,178 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,179 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,179 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,179 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,179 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:23,179 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:23,179 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:23,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 07:08:23,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d810ecb[Count = 1] remaining members to acquire global barrier 2023-07-24 07:08:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 07:08:23,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d810ecb[Count = 0] remaining members to acquire global barrier 2023-07-24 07:08:23,183 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 07:08:23,184 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:23,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,186 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:23,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,185 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:23,186 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:23,186 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:23,186 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:08:23,186 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:23,186 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:23,185 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:23,186 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:23,186 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. started... 2023-07-24 07:08:23,186 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:23,186 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,186 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:08:23,186 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. started... 2023-07-24 07:08:23,188 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 776696768bad16766570b31d7201fb55: 2023-07-24 07:08:23,190 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3756b46a809b4ca80a914d903b43f6d3: 2023-07-24 07:08:23,190 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,190 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:23,190 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:23,190 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:23,190 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:23,190 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,205 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:08:23,207 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:23,207 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:08:23,220 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:23,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:23,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:23,221 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:08:23,243 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. completed. 2023-07-24 07:08:23,243 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:23,243 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:23,243 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:23,243 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,243 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:23,243 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:08:23,245 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:23,245 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,245 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:23,245 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,253 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. completed. 2023-07-24 07:08:23,253 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:23,253 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:23,253 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:23,253 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,253 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:23,253 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:08:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:08:23,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 07:08:23,257 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:23,257 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,257 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,257 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44253,1690182392310': 2023-07-24 07:08:23,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 07:08:23,261 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 07:08:23,261 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:08:23,261 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:08:23,263 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,263 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:08:23,266 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,266 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,266 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,267 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,267 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,267 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,268 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,268 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,268 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,268 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,271 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,272 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,272 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,279 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 07:08:23,282 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,282 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,282 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,282 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,282 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,282 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,282 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:23,282 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,282 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,286 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,286 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,286 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,286 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,286 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,285 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,284 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,287 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,287 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,329 WARN [DataStreamer for file /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp/data.manifest] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-24 07:08:23,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 07:08:23,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,331 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690182503118Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690182503285 (+167 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690182503285Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690182503293 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690182503303 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690182503330 (+27 ms) 2023-07-24 07:08:23,334 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:23,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 215 msec 2023-07-24 07:08:23,421 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:23,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:23,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:08:23,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44253] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:08:23,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33211] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:08:23,434 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,434 DEBUG [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:23,434 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:23,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:23,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182503446 (current time:1690182503446). 2023-07-24 07:08:23,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:08:23,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x6cfc36be to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:23,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47a938e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:23,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:23,481 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:23,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cfc36be to 127.0.0.1:64453 2023-07-24 07:08:23,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:23,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(139): Connect 0x700c843e to 127.0.0.1:64453 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:23,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dc80547, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:23,521 DEBUG [hconnection-0x73285c34-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:23,522 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:23,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:23,535 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:23,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x700c843e to 127.0.0.1:64453 2023-07-24 07:08:23,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:23,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 07:08:23,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:08:23,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:23,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:23,543 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:23,544 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690183103544 2023-07-24 07:08:23,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:23,544 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,545 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:08:23,546 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:08:23,546 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:23,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:23,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-24 07:08:23,552 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:23,553 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690183103553 2023-07-24 07:08:23,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,573 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 07:08:23,574 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:23,575 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 07:08:23,576 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 07:08:23,576 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,576 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,578 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,579 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,579 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,580 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,581 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:08:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 07:08:23,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:23,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 07:08:23,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 07:08:23,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:23,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:23,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:23,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:23,587 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:23,588 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:23,588 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:23,588 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43589,1690182392179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:23,590 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,590 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,590 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,590 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,591 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,591 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,591 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:23,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,592 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,592 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:23,592 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,592 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:23,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44253,1690182392310' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 07:08:23,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56cfaf4f[Count = 1] remaining members to acquire global barrier 2023-07-24 07:08:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33211,1690182392248' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 07:08:23,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56cfaf4f[Count = 0] remaining members to acquire global barrier 2023-07-24 07:08:23,598 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 07:08:23,598 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,608 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,608 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,608 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,609 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:23,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,609 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,608 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:23,609 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:23,609 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:23,609 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:23,609 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. started... 2023-07-24 07:08:23,609 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3756b46a809b4ca80a914d903b43f6d3 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 07:08:23,609 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,609 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:08:23,611 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:23,611 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:23,611 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43589,1690182392179' in zk 2023-07-24 07:08:23,612 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:23,612 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:23,612 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:23,612 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. started... 2023-07-24 07:08:23,612 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 776696768bad16766570b31d7201fb55 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 07:08:23,613 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:23,613 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:23,614 DEBUG [member: 'jenkins-hbase4.apache.org,43589,1690182392179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:23,628 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/.tmp/cf/b5fffb06140f406fb40f4e15374a1b28 2023-07-24 07:08:23,628 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/.tmp/cf/f3a8a940262c40f99225039fb5261a9e 2023-07-24 07:08:23,636 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/.tmp/cf/b5fffb06140f406fb40f4e15374a1b28 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf/b5fffb06140f406fb40f4e15374a1b28 2023-07-24 07:08:23,636 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/.tmp/cf/f3a8a940262c40f99225039fb5261a9e as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf/f3a8a940262c40f99225039fb5261a9e 2023-07-24 07:08:23,641 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf/b5fffb06140f406fb40f4e15374a1b28, entries=2, sequenceid=6, filesize=5.0 K 2023-07-24 07:08:23,642 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf/f3a8a940262c40f99225039fb5261a9e, entries=48, sequenceid=6, filesize=8.1 K 2023-07-24 07:08:23,642 INFO [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 3756b46a809b4ca80a914d903b43f6d3 in 33ms, sequenceid=6, compaction requested=false 2023-07-24 07:08:23,644 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3756b46a809b4ca80a914d903b43f6d3: 2023-07-24 07:08:23,644 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,644 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:23,644 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf/b5fffb06140f406fb40f4e15374a1b28] hfiles 2023-07-24 07:08:23,645 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf/b5fffb06140f406fb40f4e15374a1b28 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,645 INFO [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 776696768bad16766570b31d7201fb55 in 32ms, sequenceid=6, compaction requested=false 2023-07-24 07:08:23,645 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 776696768bad16766570b31d7201fb55: 2023-07-24 07:08:23,645 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,645 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:23,645 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf/f3a8a940262c40f99225039fb5261a9e] hfiles 2023-07-24 07:08:23,645 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf/f3a8a940262c40f99225039fb5261a9e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,646 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:23,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:23,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:23,648 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:08:23,673 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. completed. 2023-07-24 07:08:23,673 DEBUG [rs(jenkins-hbase4.apache.org,44253,1690182392310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44253,1690182392310' in zk 2023-07-24 07:08:23,674 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. completed. 2023-07-24 07:08:23,675 DEBUG [rs(jenkins-hbase4.apache.org,33211,1690182392248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33211,1690182392248' in zk 2023-07-24 07:08:23,675 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,44253,1690182392310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:23,678 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,33211,1690182392248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44253,1690182392310': 2023-07-24 07:08:23,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44253,1690182392310' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 07:08:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33211,1690182392248': 2023-07-24 07:08:23,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33211,1690182392248' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 07:08:23,691 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 07:08:23,691 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:08:23,691 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:08:23,691 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,691 INFO [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:08:23,696 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,697 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,696 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:23,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,698 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:23,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,699 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,699 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,701 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:23,702 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,702 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,705 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,705 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,705 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,705 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,705 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,705 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:23,705 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:23,705 DEBUG [(jenkins-hbase4.apache.org,38165,1690182390732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:23,705 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,707 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,707 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,707 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,707 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:23,707 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,707 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:23,708 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:08:23,708 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,708 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,705 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:23,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:23,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:23,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,793 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 07:08:23,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,794 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690182503545Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690182503708 (+163 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690182503708Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690182503712 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690182503726 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690182503793 (+67 ms) 2023-07-24 07:08:23,798 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:23,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 252 msec 2023-07-24 07:08:23,848 DEBUG [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:23,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:23,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:08:23,850 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850 2023-07-24 07:08:23,850 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42803, tgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850, rawTgtDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850, srcFsUri=hdfs://localhost:42803, srcDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:08:23,891 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499 2023-07-24 07:08:23,891 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_588362085_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:23,891 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42803, inputRoot=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499, snapshotDir=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 07:08:23,918 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:24,041 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,041 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,042 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,042 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,042 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,043 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,043 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,138 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/hadoop-2277829801954050063.jar 2023-07-24 07:08:24,139 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,140 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,140 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,141 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,141 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,142 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:24,142 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:08:24,143 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:08:24,143 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:08:24,144 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:08:24,145 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:08:24,145 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:08:24,146 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:08:24,146 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:08:24,147 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:08:24,147 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:08:24,148 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:24,148 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:24,149 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:24,149 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:24,150 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:24,150 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:24,151 DEBUG [Listener at jenkins-hbase4.apache.org/46687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:25,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0006_000001 (auth:SIMPLE) 2023-07-24 07:08:25,921 WARN [Listener at jenkins-hbase4.apache.org/46687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:08:25,924 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 07:08:25,926 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 07:08:26,016 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:26,016 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:26,051 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:27,070 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:08:32,112 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:34,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:40,480 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:08:40,480 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:08:40,537 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,537 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:08:40,537 INFO [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:08:40,538 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,538 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 07:08:40,538 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 07:08:40,538 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_797129784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,539 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 07:08:40,539 DEBUG [Listener at jenkins-hbase4.apache.org/46687] snapshot.TestExportSnapshot(367): hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/export-test/export-1690182503850/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 07:08:40,554 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 07:08:40,561 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182520561"}]},"ts":"1690182520561"} 2023-07-24 07:08:40,563 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 07:08:40,564 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 07:08:40,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3756b46a809b4ca80a914d903b43f6d3, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=776696768bad16766570b31d7201fb55, UNASSIGN}] 2023-07-24 07:08:40,569 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=776696768bad16766570b31d7201fb55, UNASSIGN 2023-07-24 07:08:40,569 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3756b46a809b4ca80a914d903b43f6d3, UNASSIGN 2023-07-24 07:08:40,570 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=776696768bad16766570b31d7201fb55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:08:40,570 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3756b46a809b4ca80a914d903b43f6d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:08:40,570 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182520570"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182520570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182520570"}]},"ts":"1690182520570"} 2023-07-24 07:08:40,570 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182520570"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182520570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182520570"}]},"ts":"1690182520570"} 2023-07-24 07:08:40,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 776696768bad16766570b31d7201fb55, server=jenkins-hbase4.apache.org,33211,1690182392248}] 2023-07-24 07:08:40,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 3756b46a809b4ca80a914d903b43f6d3, server=jenkins-hbase4.apache.org,44253,1690182392310}] 2023-07-24 07:08:40,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 07:08:40,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:40,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 776696768bad16766570b31d7201fb55 2023-07-24 07:08:40,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3756b46a809b4ca80a914d903b43f6d3, disabling compactions & flushes 2023-07-24 07:08:40,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 776696768bad16766570b31d7201fb55, disabling compactions & flushes 2023-07-24 07:08:40,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:40,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. after waiting 0 ms 2023-07-24 07:08:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. after waiting 0 ms 2023-07-24 07:08:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:40,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:40,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:40,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:40,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:40,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55. 2023-07-24 07:08:40,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3. 2023-07-24 07:08:40,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 776696768bad16766570b31d7201fb55: 2023-07-24 07:08:40,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3756b46a809b4ca80a914d903b43f6d3: 2023-07-24 07:08:40,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:40,757 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3756b46a809b4ca80a914d903b43f6d3, regionState=CLOSED 2023-07-24 07:08:40,757 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182520757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182520757"}]},"ts":"1690182520757"} 2023-07-24 07:08:40,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 776696768bad16766570b31d7201fb55 2023-07-24 07:08:40,760 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=776696768bad16766570b31d7201fb55, regionState=CLOSED 2023-07-24 07:08:40,760 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182520760"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182520760"}]},"ts":"1690182520760"} 2023-07-24 07:08:40,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-24 07:08:40,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 3756b46a809b4ca80a914d903b43f6d3, server=jenkins-hbase4.apache.org,44253,1690182392310 in 186 msec 2023-07-24 07:08:40,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3756b46a809b4ca80a914d903b43f6d3, UNASSIGN in 197 msec 2023-07-24 07:08:40,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-24 07:08:40,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 776696768bad16766570b31d7201fb55, server=jenkins-hbase4.apache.org,33211,1690182392248 in 190 msec 2023-07-24 07:08:40,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-24 07:08:40,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=776696768bad16766570b31d7201fb55, UNASSIGN in 207 msec 2023-07-24 07:08:40,775 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182520775"}]},"ts":"1690182520775"} 2023-07-24 07:08:40,778 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 07:08:40,779 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 07:08:40,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 238 msec 2023-07-24 07:08:40,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 07:08:40,864 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 07:08:40,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,869 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,871 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,872 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43589] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,877 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,877 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,877 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,877 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,877 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:40,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 07:08:40,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 07:08:40,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 07:08:40,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 07:08:40,878 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55 2023-07-24 07:08:40,878 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,878 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,878 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,878 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:40,878 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,879 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:40,878 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:40,878 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:40,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 07:08:40,882 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/recovered.edits] 2023-07-24 07:08:40,883 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf, FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/recovered.edits] 2023-07-24 07:08:40,891 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf/b5fffb06140f406fb40f4e15374a1b28 to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/cf/b5fffb06140f406fb40f4e15374a1b28 2023-07-24 07:08:40,896 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3/recovered.edits/9.seqid 2023-07-24 07:08:40,897 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3756b46a809b4ca80a914d903b43f6d3 2023-07-24 07:08:40,902 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf/f3a8a940262c40f99225039fb5261a9e to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/cf/f3a8a940262c40f99225039fb5261a9e 2023-07-24 07:08:40,908 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/recovered.edits/9.seqid to hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55/recovered.edits/9.seqid 2023-07-24 07:08:40,909 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/776696768bad16766570b31d7201fb55 2023-07-24 07:08:40,909 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 07:08:40,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,915 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 07:08:40,919 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 07:08:40,920 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,920 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 07:08:40,920 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182520920"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:40,921 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182520920"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:40,923 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:08:40,923 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3756b46a809b4ca80a914d903b43f6d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690182501786.3756b46a809b4ca80a914d903b43f6d3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 776696768bad16766570b31d7201fb55, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182501786.776696768bad16766570b31d7201fb55.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:08:40,923 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 07:08:40,923 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182520923"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:40,925 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 07:08:40,928 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 63 msec 2023-07-24 07:08:40,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 07:08:40,981 INFO [Listener at jenkins-hbase4.apache.org/46687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 07:08:40,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 07:08:40,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:40,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 07:08:40,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38165] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:41,034 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=768 (was 766) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (33067392) connection to jenkins-hbase4.apache.org/172.31.14.131:37551 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_869937933_1 at /127.0.0.1:36676 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5204 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:57974 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_797129784_17 at /127.0.0.1:44338 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b72281d-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=560 (was 451) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=4101 (was 4906) 2023-07-24 07:08:41,035 WARN [Listener at jenkins-hbase4.apache.org/46687] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-24 07:08:41,035 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 07:08:41,073 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 07:08:41,075 WARN [1383497240@qtp-1355231481-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39427] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-24 07:08:41,075 WARN [1383497240@qtp-1355231481-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39427] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-24 07:08:45,414 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182400023_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:46,383 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:08:55,200 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 07:09:09,327 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 07:09:09,327 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 07:09:09,441 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 07:09:09,458 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 07:09:09,459 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 07:09:09,470 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 07:09:09,574 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 07:09:09,575 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 07:09:09,575 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 07:09:09,575 INFO [Listener at jenkins-hbase4.apache.org/46687] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 07:09:09,575 DEBUG [Listener at jenkins-hbase4.apache.org/46687] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d81a277 to 127.0.0.1:64453 2023-07-24 07:09:09,575 DEBUG [Listener at jenkins-hbase4.apache.org/46687] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:09,575 DEBUG [Listener at jenkins-hbase4.apache.org/46687] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 07:09:09,575 DEBUG [Listener at jenkins-hbase4.apache.org/46687] util.JVMClusterUtil(257): Found active master hash=173217403, stopped=false 2023-07-24 07:09:09,576 DEBUG [Listener at jenkins-hbase4.apache.org/46687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:09,576 DEBUG [Listener at jenkins-hbase4.apache.org/46687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 07:09:09,576 INFO [Listener at jenkins-hbase4.apache.org/46687] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:09:09,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 07:09:09,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 07:09:09,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 07:09:09,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:09:09,578 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 07:09:09,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:09:09,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:09:09,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:09:09,578 INFO [Listener at jenkins-hbase4.apache.org/46687] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 07:09:09,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:09:09,579 DEBUG [Listener at jenkins-hbase4.apache.org/46687] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3eeffd45 to 127.0.0.1:64453 2023-07-24 07:09:09,579 DEBUG [Listener at jenkins-hbase4.apache.org/46687] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:09,579 INFO [Listener at jenkins-hbase4.apache.org/46687] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43589,1690182392179' ***** 2023-07-24 07:09:09,580 DEBUG [Listener at jenkins-hbase4.apache.org/46687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:09,580 INFO [Listener at jenkins-hbase4.apache.org/46687] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 07:09:09,580 INFO [Listener at jenkins-hbase4.apache.org/46687] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33211,1690182392248' ***** 2023-07-24 07:09:09,580 DEBUG [Listener at jenkins-hbase4.apache.org/46687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:09,580 INFO [Listener at jenkins-hbase4.apache.org/46687] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 07:09:09,580 INFO [RS:0;jenkins-hbase4:43589] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 07:09:09,581 INFO [RS:1;jenkins-hbase4:33211] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 07:09:09,580 INFO [Listener at jenkins-hbase4.apache.org/46687] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44253,1690182392310' ***** 2023-07-24 07:09:09,581 INFO [RS:1;jenkins-hbase4:33211] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 07:09:09,581 DEBUG [Listener at jenkins-hbase4.apache.org/46687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:09,581 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 07:09:09,581 INFO [RS:0;jenkins-hbase4:43589] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 07:09:09,581 INFO [Listener at jenkins-hbase4.apache.org/46687] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 07:09:09,581 INFO [RS:1;jenkins-hbase4:33211] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 07:09:09,581 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 07:09:09,581 INFO [RS:2;jenkins-hbase4:44253] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 07:09:09,581 INFO [RS:0;jenkins-hbase4:43589] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 07:09:09,581 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 07:09:09,581 INFO [RS:2;jenkins-hbase4:44253] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 07:09:09,581 INFO [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:09:09,582 DEBUG [RS:1;jenkins-hbase4:33211] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f2e9774 to 127.0.0.1:64453 2023-07-24 07:09:09,582 DEBUG [RS:1;jenkins-hbase4:33211] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:09,582 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(3305): Received CLOSE for ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:09:09,582 INFO [RS:2;jenkins-hbase4:44253] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 07:09:09,585 INFO [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33211,1690182392248; all regions closed. 2023-07-24 07:09:09,585 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:09:09,585 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(3305): Received CLOSE for 3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:09:09,585 DEBUG [RS:0;jenkins-hbase4:43589] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62da0c26 to 127.0.0.1:64453 2023-07-24 07:09:09,586 DEBUG [RS:0;jenkins-hbase4:43589] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:09,585 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:09:09,586 DEBUG [RS:2;jenkins-hbase4:44253] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54aba08c to 127.0.0.1:64453 2023-07-24 07:09:09,586 DEBUG [RS:2;jenkins-hbase4:44253] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:09,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ad8203f24d6ca8146539c11ce1c01d2e, disabling compactions & flushes 2023-07-24 07:09:09,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3bbb1ff0cbf023d434368f1d0dab797d, disabling compactions & flushes 2023-07-24 07:09:09,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:09:09,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:09:09,587 INFO [RS:2;jenkins-hbase4:44253] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 07:09:09,587 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 07:09:09,587 INFO [RS:2;jenkins-hbase4:44253] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 07:09:09,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. after waiting 0 ms 2023-07-24 07:09:09,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:09:09,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:09:09,588 INFO [RS:2;jenkins-hbase4:44253] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 07:09:09,587 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1478): Online Regions={ad8203f24d6ca8146539c11ce1c01d2e=hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e.} 2023-07-24 07:09:09,588 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 07:09:09,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ad8203f24d6ca8146539c11ce1c01d2e 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 07:09:09,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:09:09,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. after waiting 0 ms 2023-07-24 07:09:09,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:09:09,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3bbb1ff0cbf023d434368f1d0dab797d 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 07:09:09,589 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1504): Waiting on ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:09:09,594 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-24 07:09:09,594 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 3bbb1ff0cbf023d434368f1d0dab797d=hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d.} 2023-07-24 07:09:09,595 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1504): Waiting on 1588230740, 3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:09:09,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 07:09:09,600 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 07:09:09,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 07:09:09,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 07:09:09,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 07:09:09,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 07:09:09,603 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:09,648 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:09,661 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:09,693 DEBUG [RS:1;jenkins-hbase4:33211] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/oldWALs 2023-07-24 07:09:09,693 INFO [RS:1;jenkins-hbase4:33211] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33211%2C1690182392248:(num 1690182394476) 2023-07-24 07:09:09,693 DEBUG [RS:1;jenkins-hbase4:33211] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:09,693 INFO [RS:1;jenkins-hbase4:33211] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:09,693 INFO [RS:1;jenkins-hbase4:33211] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 07:09:09,708 INFO [RS:1;jenkins-hbase4:33211] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 07:09:09,708 INFO [RS:1;jenkins-hbase4:33211] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 07:09:09,708 INFO [RS:1;jenkins-hbase4:33211] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 07:09:09,708 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 07:09:09,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e/.tmp/l/eb90fc8b96ae44e48365fe074f0ab4f6 2023-07-24 07:09:09,713 INFO [RS:1;jenkins-hbase4:33211] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33211 2023-07-24 07:09:09,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d/.tmp/info/8a0c50f66f81410a9b7f45bfa5d8d8f8 2023-07-24 07:09:09,738 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:09:09,738 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:09,738 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:09,738 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:09:09,738 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33211,1690182392248 2023-07-24 07:09:09,738 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:09,738 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:09,739 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33211,1690182392248] 2023-07-24 07:09:09,748 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33211,1690182392248; numProcessing=1 2023-07-24 07:09:09,751 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33211,1690182392248 already deleted, retry=false 2023-07-24 07:09:09,751 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33211,1690182392248 expired; onlineServers=2 2023-07-24 07:09:09,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb90fc8b96ae44e48365fe074f0ab4f6 2023-07-24 07:09:09,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d/.tmp/info/8a0c50f66f81410a9b7f45bfa5d8d8f8 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d/info/8a0c50f66f81410a9b7f45bfa5d8d8f8 2023-07-24 07:09:09,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/.tmp/info/df042eacfe414afdbc242806cdef5ece 2023-07-24 07:09:09,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e/.tmp/l/eb90fc8b96ae44e48365fe074f0ab4f6 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e/l/eb90fc8b96ae44e48365fe074f0ab4f6 2023-07-24 07:09:09,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d/info/8a0c50f66f81410a9b7f45bfa5d8d8f8, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 07:09:09,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3bbb1ff0cbf023d434368f1d0dab797d in 180ms, sequenceid=6, compaction requested=false 2023-07-24 07:09:09,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb90fc8b96ae44e48365fe074f0ab4f6 2023-07-24 07:09:09,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e/l/eb90fc8b96ae44e48365fe074f0ab4f6, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 07:09:09,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df042eacfe414afdbc242806cdef5ece 2023-07-24 07:09:09,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ad8203f24d6ca8146539c11ce1c01d2e in 185ms, sequenceid=18, compaction requested=false 2023-07-24 07:09:09,789 DEBUG [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1504): Waiting on ad8203f24d6ca8146539c11ce1c01d2e 2023-07-24 07:09:09,795 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1504): Waiting on 1588230740, 3bbb1ff0cbf023d434368f1d0dab797d 2023-07-24 07:09:09,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/namespace/3bbb1ff0cbf023d434368f1d0dab797d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:09:09,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:09,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:09:09,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3bbb1ff0cbf023d434368f1d0dab797d: 2023-07-24 07:09:09,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690182395094.3bbb1ff0cbf023d434368f1d0dab797d. 2023-07-24 07:09:09,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/acl/ad8203f24d6ca8146539c11ce1c01d2e/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 07:09:09,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:09,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:09:09,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ad8203f24d6ca8146539c11ce1c01d2e: 2023-07-24 07:09:09,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690182395959.ad8203f24d6ca8146539c11ce1c01d2e. 2023-07-24 07:09:09,840 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:09,840 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:33211-0x101962713120002, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:09,840 INFO [RS:1;jenkins-hbase4:33211] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33211,1690182392248; zookeeper connection closed. 2023-07-24 07:09:09,865 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1b26bbd1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1b26bbd1 2023-07-24 07:09:09,874 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/.tmp/rep_barrier/166ceb0ee49e4716baf5d3f74d09f683 2023-07-24 07:09:09,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 166ceb0ee49e4716baf5d3f74d09f683 2023-07-24 07:09:09,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/.tmp/table/19a93cd15ddf4de581db205ccb025ac6 2023-07-24 07:09:09,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19a93cd15ddf4de581db205ccb025ac6 2023-07-24 07:09:09,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/.tmp/info/df042eacfe414afdbc242806cdef5ece as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/info/df042eacfe414afdbc242806cdef5ece 2023-07-24 07:09:09,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df042eacfe414afdbc242806cdef5ece 2023-07-24 07:09:09,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/info/df042eacfe414afdbc242806cdef5ece, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 07:09:09,948 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/.tmp/rep_barrier/166ceb0ee49e4716baf5d3f74d09f683 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/rep_barrier/166ceb0ee49e4716baf5d3f74d09f683 2023-07-24 07:09:09,958 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 166ceb0ee49e4716baf5d3f74d09f683 2023-07-24 07:09:09,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/rep_barrier/166ceb0ee49e4716baf5d3f74d09f683, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 07:09:09,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/.tmp/table/19a93cd15ddf4de581db205ccb025ac6 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/table/19a93cd15ddf4de581db205ccb025ac6 2023-07-24 07:09:09,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19a93cd15ddf4de581db205ccb025ac6 2023-07-24 07:09:09,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/table/19a93cd15ddf4de581db205ccb025ac6, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 07:09:09,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 368ms, sequenceid=131, compaction requested=false 2023-07-24 07:09:09,989 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43589,1690182392179; all regions closed. 2023-07-24 07:09:09,997 DEBUG [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 07:09:10,021 DEBUG [RS:0;jenkins-hbase4:43589] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/oldWALs 2023-07-24 07:09:10,021 INFO [RS:0;jenkins-hbase4:43589] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43589%2C1690182392179:(num 1690182394483) 2023-07-24 07:09:10,021 DEBUG [RS:0;jenkins-hbase4:43589] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:10,021 INFO [RS:0;jenkins-hbase4:43589] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:10,022 INFO [RS:0;jenkins-hbase4:43589] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 07:09:10,030 INFO [RS:0;jenkins-hbase4:43589] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 07:09:10,030 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 07:09:10,031 INFO [RS:0;jenkins-hbase4:43589] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 07:09:10,031 INFO [RS:0;jenkins-hbase4:43589] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 07:09:10,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 07:09:10,033 INFO [RS:0;jenkins-hbase4:43589] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43589 2023-07-24 07:09:10,036 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:10,037 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 07:09:10,038 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 07:09:10,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 07:09:10,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 07:09:10,101 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:10,101 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:09:10,101 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43589,1690182392179 2023-07-24 07:09:10,102 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43589,1690182392179] 2023-07-24 07:09:10,102 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43589,1690182392179; numProcessing=2 2023-07-24 07:09:10,170 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43589,1690182392179 already deleted, retry=false 2023-07-24 07:09:10,170 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43589,1690182392179 expired; onlineServers=1 2023-07-24 07:09:10,197 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44253,1690182392310; all regions closed. 2023-07-24 07:09:10,204 DEBUG [RS:2;jenkins-hbase4:44253] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/oldWALs 2023-07-24 07:09:10,204 INFO [RS:2;jenkins-hbase4:44253] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44253%2C1690182392310.meta:.meta(num 1690182394701) 2023-07-24 07:09:10,210 DEBUG [RS:2;jenkins-hbase4:44253] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/oldWALs 2023-07-24 07:09:10,210 INFO [RS:2;jenkins-hbase4:44253] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44253%2C1690182392310:(num 1690182394479) 2023-07-24 07:09:10,210 DEBUG [RS:2;jenkins-hbase4:44253] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:10,210 INFO [RS:2;jenkins-hbase4:44253] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:10,210 INFO [RS:2;jenkins-hbase4:44253] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 07:09:10,211 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 07:09:10,229 INFO [RS:2;jenkins-hbase4:44253] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44253 2023-07-24 07:09:10,240 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:10,240 INFO [RS:0;jenkins-hbase4:43589] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43589,1690182392179; zookeeper connection closed. 2023-07-24 07:09:10,240 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:43589-0x101962713120001, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:10,240 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@570032c3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@570032c3 2023-07-24 07:09:10,293 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:10,293 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44253,1690182392310 2023-07-24 07:09:10,294 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44253,1690182392310] 2023-07-24 07:09:10,294 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44253,1690182392310; numProcessing=3 2023-07-24 07:09:10,339 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44253,1690182392310 already deleted, retry=false 2023-07-24 07:09:10,340 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44253,1690182392310 expired; onlineServers=0 2023-07-24 07:09:10,340 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38165,1690182390732' ***** 2023-07-24 07:09:10,340 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 07:09:10,340 DEBUG [M:0;jenkins-hbase4:38165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b6e1c40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 07:09:10,340 INFO [M:0;jenkins-hbase4:38165] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38165,1690182390732 2023-07-24 07:09:10,340 INFO [M:0;jenkins-hbase4:38165] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38165,1690182390732; all regions closed. 2023-07-24 07:09:10,340 DEBUG [M:0;jenkins-hbase4:38165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:10,340 DEBUG [M:0;jenkins-hbase4:38165] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 07:09:10,340 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 07:09:10,341 DEBUG [M:0;jenkins-hbase4:38165] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 07:09:10,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690182394011] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690182394011,5,FailOnTimeoutGroup] 2023-07-24 07:09:10,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690182394012] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690182394012,5,FailOnTimeoutGroup] 2023-07-24 07:09:10,341 INFO [M:0;jenkins-hbase4:38165] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 07:09:10,341 INFO [M:0;jenkins-hbase4:38165] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 07:09:10,341 INFO [M:0;jenkins-hbase4:38165] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 07:09:10,341 DEBUG [M:0;jenkins-hbase4:38165] master.HMaster(1512): Stopping service threads 2023-07-24 07:09:10,341 INFO [M:0;jenkins-hbase4:38165] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 07:09:10,342 ERROR [M:0;jenkins-hbase4:38165] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 07:09:10,342 INFO [M:0;jenkins-hbase4:38165] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 07:09:10,342 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 07:09:10,425 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:10,425 INFO [RS:2;jenkins-hbase4:44253] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44253,1690182392310; zookeeper connection closed. 2023-07-24 07:09:10,425 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): regionserver:44253-0x101962713120003, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:10,425 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3379cbdf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3379cbdf 2023-07-24 07:09:10,425 INFO [Listener at jenkins-hbase4.apache.org/46687] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 07:09:10,426 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 07:09:10,426 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:09:10,426 INFO [M:0;jenkins-hbase4:38165] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 07:09:10,427 INFO [M:0;jenkins-hbase4:38165] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 07:09:10,427 DEBUG [M:0;jenkins-hbase4:38165] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 07:09:10,428 INFO [M:0;jenkins-hbase4:38165] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:09:10,428 DEBUG [M:0;jenkins-hbase4:38165] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:09:10,428 DEBUG [M:0;jenkins-hbase4:38165] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 07:09:10,428 DEBUG [M:0;jenkins-hbase4:38165] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:09:10,428 INFO [M:0;jenkins-hbase4:38165] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.12 KB heapSize=449.41 KB 2023-07-24 07:09:10,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:09:10,428 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-07-24 07:09:10,428 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(335): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-07-24 07:09:10,451 INFO [M:0;jenkins-hbase4:38165] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.12 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ce3f01a94afc4fd6849089a04f42e519 2023-07-24 07:09:10,456 INFO [M:0;jenkins-hbase4:38165] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce3f01a94afc4fd6849089a04f42e519 2023-07-24 07:09:10,458 DEBUG [M:0;jenkins-hbase4:38165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ce3f01a94afc4fd6849089a04f42e519 as hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ce3f01a94afc4fd6849089a04f42e519 2023-07-24 07:09:10,472 INFO [M:0;jenkins-hbase4:38165] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce3f01a94afc4fd6849089a04f42e519 2023-07-24 07:09:10,472 INFO [M:0;jenkins-hbase4:38165] regionserver.HStore(1080): Added hdfs://localhost:42803/user/jenkins/test-data/68520654-f3ba-6025-01eb-0e1460f39499/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ce3f01a94afc4fd6849089a04f42e519, entries=119, sequenceid=899, filesize=28.4 K 2023-07-24 07:09:10,473 INFO [M:0;jenkins-hbase4:38165] regionserver.HRegion(2948): Finished flush of dataSize ~373.12 KB/382074, heapSize ~449.39 KB/460176, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 45ms, sequenceid=899, compaction requested=false 2023-07-24 07:09:10,497 INFO [M:0;jenkins-hbase4:38165] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:09:10,498 DEBUG [M:0;jenkins-hbase4:38165] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 07:09:10,523 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 07:09:10,523 INFO [M:0;jenkins-hbase4:38165] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 07:09:10,524 INFO [M:0;jenkins-hbase4:38165] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38165 2023-07-24 07:09:10,526 DEBUG [M:0;jenkins-hbase4:38165] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38165,1690182390732 already deleted, retry=false 2023-07-24 07:09:10,628 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:10,628 INFO [M:0;jenkins-hbase4:38165] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38165,1690182390732; zookeeper connection closed. 2023-07-24 07:09:10,628 DEBUG [Listener at localhost/37839-EventThread] zookeeper.ZKWatcher(600): master:38165-0x101962713120000, quorum=127.0.0.1:64453, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:10,630 WARN [Listener at jenkins-hbase4.apache.org/46687] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 07:09:10,646 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 07:09:10,749 WARN [BP-1493154514-172.31.14.131-1690182386651 heartbeating to localhost/127.0.0.1:42803] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 07:09:10,749 WARN [BP-1493154514-172.31.14.131-1690182386651 heartbeating to localhost/127.0.0.1:42803] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1493154514-172.31.14.131-1690182386651 (Datanode Uuid 683bc870-44e9-4f8d-be09-f0367fbf953a) service to localhost/127.0.0.1:42803 2023-07-24 07:09:10,752 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data6/current/BP-1493154514-172.31.14.131-1690182386651] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:10,754 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data5/current/BP-1493154514-172.31.14.131-1690182386651] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:10,758 WARN [Listener at jenkins-hbase4.apache.org/46687] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 07:09:10,770 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 07:09:10,877 WARN [BP-1493154514-172.31.14.131-1690182386651 heartbeating to localhost/127.0.0.1:42803] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 07:09:10,878 WARN [BP-1493154514-172.31.14.131-1690182386651 heartbeating to localhost/127.0.0.1:42803] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1493154514-172.31.14.131-1690182386651 (Datanode Uuid 30503cfa-114b-4905-bc04-52bfa0d78188) service to localhost/127.0.0.1:42803 2023-07-24 07:09:10,879 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data4/current/BP-1493154514-172.31.14.131-1690182386651] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:10,880 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data3/current/BP-1493154514-172.31.14.131-1690182386651] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:10,880 WARN [Listener at jenkins-hbase4.apache.org/46687] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 07:09:10,904 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 07:09:10,910 WARN [BP-1493154514-172.31.14.131-1690182386651 heartbeating to localhost/127.0.0.1:42803] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 07:09:10,911 WARN [BP-1493154514-172.31.14.131-1690182386651 heartbeating to localhost/127.0.0.1:42803] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1493154514-172.31.14.131-1690182386651 (Datanode Uuid 9ca97a74-72fb-45a3-9209-59d147acef0c) service to localhost/127.0.0.1:42803 2023-07-24 07:09:10,911 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data1/current/BP-1493154514-172.31.14.131-1690182386651] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:10,912 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/948d432b-3d76-01da-82f3-621fb55b944f/cluster_b1d5e7b3-7c85-96c1-b749-edbce1740cbd/dfs/data/data2/current/BP-1493154514-172.31.14.131-1690182386651] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:10,928 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:10,928 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 07:09:10,928 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:10,928 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 07:09:10,928 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:10,955 INFO [Listener at jenkins-hbase4.apache.org/46687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 07:09:10,999 INFO [Listener at jenkins-hbase4.apache.org/46687] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 07:09:11,107 INFO [Listener at jenkins-hbase4.apache.org/46687] hbase.HBaseTestingUtility(1293): Minicluster is down