2023-07-21 05:09:51,785 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-21 05:09:52,046 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff 2023-07-21 05:09:52,047 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-21 05:09:52,095 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-21 05:09:52,404 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-21 05:09:52,405 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d, deleteOnExit=true 2023-07-21 05:09:52,405 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-21 05:09:52,406 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/test.cache.data in system properties and HBase conf 2023-07-21 05:09:52,406 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 05:09:52,407 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop.log.dir in system properties and HBase conf 2023-07-21 05:09:52,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 05:09:52,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 05:09:52,408 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 05:09:52,781 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-21 05:09:52,787 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 05:09:52,787 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 05:09:52,787 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 05:09:52,787 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 05:09:52,788 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 05:09:52,788 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 05:09:52,788 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 05:09:52,789 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 05:09:52,789 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 05:09:52,790 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/nfs.dump.dir in system properties and HBase conf 2023-07-21 05:09:52,790 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir in system properties and HBase conf 2023-07-21 05:09:52,790 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 05:09:52,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 05:09:52,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-21 05:09:53,418 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 05:09:53,423 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 05:09:53,773 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-21 05:09:53,965 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-21 05:09:53,983 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:09:54,025 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:09:54,063 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir/Jetty_localhost_32827_hdfs____qddh7s/webapp 2023-07-21 05:09:54,241 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32827 2023-07-21 05:09:54,263 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 05:09:54,263 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 05:09:54,811 WARN [Listener at localhost/36811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 05:09:54,916 WARN [Listener at localhost/36811] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 05:09:54,946 WARN [Listener at localhost/36811] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:09:54,956 INFO [Listener at localhost/36811] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:09:55,025 INFO [Listener at localhost/36811] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir/Jetty_localhost_44121_datanode____.h9xg89/webapp 2023-07-21 05:09:55,134 INFO [Listener at localhost/36811] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44121 2023-07-21 05:09:55,622 WARN [Listener at localhost/34831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 05:09:55,705 WARN [Listener at localhost/34831] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 05:09:55,712 WARN [Listener at localhost/34831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:09:55,714 INFO [Listener at localhost/34831] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:09:55,722 INFO [Listener at localhost/34831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir/Jetty_localhost_43457_datanode____brlrvi/webapp 2023-07-21 05:09:55,831 INFO [Listener at localhost/34831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43457 2023-07-21 05:09:55,855 WARN [Listener at localhost/33257] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 05:09:55,893 WARN [Listener at localhost/33257] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 05:09:55,897 WARN [Listener at localhost/33257] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:09:55,900 INFO [Listener at localhost/33257] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:09:55,911 INFO [Listener at localhost/33257] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir/Jetty_localhost_39303_datanode____.ozpknd/webapp 2023-07-21 05:09:56,073 INFO [Listener at localhost/33257] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39303 2023-07-21 05:09:56,099 WARN [Listener at localhost/36037] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 05:09:56,432 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd4b19a408f33db5c: Processing first storage report for DS-678e7a63-519d-4292-a8e9-a4194e234e49 from datanode 1dee6154-569f-41f2-8216-113db5354bec 2023-07-21 05:09:56,435 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd4b19a408f33db5c: from storage DS-678e7a63-519d-4292-a8e9-a4194e234e49 node DatanodeRegistration(127.0.0.1:33623, datanodeUuid=1dee6154-569f-41f2-8216-113db5354bec, infoPort=42213, infoSecurePort=0, ipcPort=34831, storageInfo=lv=-57;cid=testClusterID;nsid=818555880;c=1689916193510), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,439 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd4b19a408f33db5c: Processing first storage report for DS-c6e0e232-f10e-425b-a020-39151e301298 from datanode 1dee6154-569f-41f2-8216-113db5354bec 2023-07-21 05:09:56,439 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd4b19a408f33db5c: from storage DS-c6e0e232-f10e-425b-a020-39151e301298 node DatanodeRegistration(127.0.0.1:33623, datanodeUuid=1dee6154-569f-41f2-8216-113db5354bec, infoPort=42213, infoSecurePort=0, ipcPort=34831, storageInfo=lv=-57;cid=testClusterID;nsid=818555880;c=1689916193510), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,439 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53c77ca01274bd51: Processing first storage report for DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52 from datanode 8ca32a74-36ea-4a45-b328-6ddec81e2657 2023-07-21 05:09:56,439 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53c77ca01274bd51: from storage DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52 node DatanodeRegistration(127.0.0.1:35959, datanodeUuid=8ca32a74-36ea-4a45-b328-6ddec81e2657, infoPort=33921, infoSecurePort=0, ipcPort=36037, storageInfo=lv=-57;cid=testClusterID;nsid=818555880;c=1689916193510), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,439 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5534d202f70a92a0: Processing first storage report for DS-87a08720-36b2-41ae-81df-11c3d97547e3 from datanode d82687ec-c166-44c0-af50-c5eb31ec2a96 2023-07-21 05:09:56,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5534d202f70a92a0: from storage DS-87a08720-36b2-41ae-81df-11c3d97547e3 node DatanodeRegistration(127.0.0.1:40267, datanodeUuid=d82687ec-c166-44c0-af50-c5eb31ec2a96, infoPort=40209, infoSecurePort=0, ipcPort=33257, storageInfo=lv=-57;cid=testClusterID;nsid=818555880;c=1689916193510), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,440 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53c77ca01274bd51: Processing first storage report for DS-a0382183-7572-4351-9e7f-db0f9972f7f1 from datanode 8ca32a74-36ea-4a45-b328-6ddec81e2657 2023-07-21 05:09:56,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53c77ca01274bd51: from storage DS-a0382183-7572-4351-9e7f-db0f9972f7f1 node DatanodeRegistration(127.0.0.1:35959, datanodeUuid=8ca32a74-36ea-4a45-b328-6ddec81e2657, infoPort=33921, infoSecurePort=0, ipcPort=36037, storageInfo=lv=-57;cid=testClusterID;nsid=818555880;c=1689916193510), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,440 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5534d202f70a92a0: Processing first storage report for DS-4946c85d-c326-4a51-8d1f-77306d10634d from datanode d82687ec-c166-44c0-af50-c5eb31ec2a96 2023-07-21 05:09:56,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5534d202f70a92a0: from storage DS-4946c85d-c326-4a51-8d1f-77306d10634d node DatanodeRegistration(127.0.0.1:40267, datanodeUuid=d82687ec-c166-44c0-af50-c5eb31ec2a96, infoPort=40209, infoSecurePort=0, ipcPort=33257, storageInfo=lv=-57;cid=testClusterID;nsid=818555880;c=1689916193510), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,719 DEBUG [Listener at localhost/36037] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff 2023-07-21 05:09:56,817 INFO [Listener at localhost/36037] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/zookeeper_0, clientPort=53187, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-21 05:09:56,844 INFO [Listener at localhost/36037] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53187 2023-07-21 05:09:56,853 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:56,856 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:57,644 INFO [Listener at localhost/36037] util.FSUtils(471): Created version file at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab with version=8 2023-07-21 05:09:57,644 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/hbase-staging 2023-07-21 05:09:57,996 INFO [Listener at localhost/36037] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-21 05:09:58,513 INFO [Listener at localhost/36037] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 05:09:58,562 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:58,563 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:58,563 INFO [Listener at localhost/36037] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 05:09:58,563 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:58,563 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 05:09:58,719 INFO [Listener at localhost/36037] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 05:09:58,796 DEBUG [Listener at localhost/36037] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-21 05:09:58,902 INFO [Listener at localhost/36037] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38519 2023-07-21 05:09:58,921 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:58,924 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:58,947 INFO [Listener at localhost/36037] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38519 connecting to ZooKeeper ensemble=127.0.0.1:53187 2023-07-21 05:09:59,007 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:385190x0, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 05:09:59,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38519-0x10186494aba0000 connected 2023-07-21 05:09:59,047 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:09:59,048 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:09:59,062 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 05:09:59,074 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38519 2023-07-21 05:09:59,075 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38519 2023-07-21 05:09:59,079 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38519 2023-07-21 05:09:59,079 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38519 2023-07-21 05:09:59,082 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38519 2023-07-21 05:09:59,091 INFO [Listener at localhost/36037] master.HMaster(444): hbase.rootdir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab, hbase.cluster.distributed=false 2023-07-21 05:09:59,184 INFO [Listener at localhost/36037] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 05:09:59,185 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,185 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,185 INFO [Listener at localhost/36037] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 05:09:59,186 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,186 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 05:09:59,191 INFO [Listener at localhost/36037] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 05:09:59,195 INFO [Listener at localhost/36037] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39445 2023-07-21 05:09:59,199 INFO [Listener at localhost/36037] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 05:09:59,207 DEBUG [Listener at localhost/36037] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 05:09:59,209 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,212 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,214 INFO [Listener at localhost/36037] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39445 connecting to ZooKeeper ensemble=127.0.0.1:53187 2023-07-21 05:09:59,225 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:394450x0, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 05:09:59,226 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:394450x0, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:09:59,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39445-0x10186494aba0001 connected 2023-07-21 05:09:59,228 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:09:59,229 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 05:09:59,230 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39445 2023-07-21 05:09:59,233 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39445 2023-07-21 05:09:59,241 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39445 2023-07-21 05:09:59,247 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39445 2023-07-21 05:09:59,248 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39445 2023-07-21 05:09:59,267 INFO [Listener at localhost/36037] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 05:09:59,268 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,268 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,269 INFO [Listener at localhost/36037] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 05:09:59,269 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,269 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 05:09:59,270 INFO [Listener at localhost/36037] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 05:09:59,272 INFO [Listener at localhost/36037] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46441 2023-07-21 05:09:59,272 INFO [Listener at localhost/36037] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 05:09:59,275 DEBUG [Listener at localhost/36037] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 05:09:59,276 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,279 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,281 INFO [Listener at localhost/36037] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46441 connecting to ZooKeeper ensemble=127.0.0.1:53187 2023-07-21 05:09:59,291 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:464410x0, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 05:09:59,292 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:464410x0, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:09:59,294 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:464410x0, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:09:59,295 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:464410x0, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 05:09:59,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46441-0x10186494aba0002 connected 2023-07-21 05:09:59,302 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46441 2023-07-21 05:09:59,303 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46441 2023-07-21 05:09:59,304 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46441 2023-07-21 05:09:59,306 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46441 2023-07-21 05:09:59,306 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46441 2023-07-21 05:09:59,319 INFO [Listener at localhost/36037] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 05:09:59,319 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,320 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,320 INFO [Listener at localhost/36037] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 05:09:59,320 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,320 INFO [Listener at localhost/36037] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 05:09:59,320 INFO [Listener at localhost/36037] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 05:09:59,322 INFO [Listener at localhost/36037] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36249 2023-07-21 05:09:59,322 INFO [Listener at localhost/36037] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 05:09:59,325 DEBUG [Listener at localhost/36037] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 05:09:59,327 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,334 INFO [Listener at localhost/36037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,336 INFO [Listener at localhost/36037] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36249 connecting to ZooKeeper ensemble=127.0.0.1:53187 2023-07-21 05:09:59,344 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:362490x0, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 05:09:59,345 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:362490x0, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:09:59,346 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:362490x0, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:09:59,347 DEBUG [Listener at localhost/36037] zookeeper.ZKUtil(164): regionserver:362490x0, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 05:09:59,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36249-0x10186494aba0003 connected 2023-07-21 05:09:59,359 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36249 2023-07-21 05:09:59,359 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36249 2023-07-21 05:09:59,363 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36249 2023-07-21 05:09:59,364 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36249 2023-07-21 05:09:59,365 DEBUG [Listener at localhost/36037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36249 2023-07-21 05:09:59,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:09:59,379 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 05:09:59,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:09:59,407 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 05:09:59,407 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 05:09:59,407 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 05:09:59,407 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 05:09:59,409 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:09:59,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 05:09:59,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38519,1689916197810 from backup master directory 2023-07-21 05:09:59,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 05:09:59,417 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:09:59,417 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 05:09:59,418 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 05:09:59,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:09:59,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-21 05:09:59,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-21 05:09:59,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/hbase.id with ID: a9f71380-5d9b-423a-b7ac-5e99a6e5ea07 2023-07-21 05:09:59,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,623 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:09:59,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x75391b56 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:09:59,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76b3b43a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:09:59,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:09:59,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-21 05:09:59,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-21 05:09:59,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-21 05:09:59,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 05:09:59,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 05:09:59,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:09:59,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store-tmp 2023-07-21 05:09:59,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:09:59,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 05:09:59,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:09:59,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:09:59,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 05:09:59,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:09:59,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:09:59,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 05:09:59,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/WALs/jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:09:59,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38519%2C1689916197810, suffix=, logDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/WALs/jenkins-hbase4.apache.org,38519,1689916197810, archiveDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/oldWALs, maxLogs=10 2023-07-21 05:10:00,007 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK] 2023-07-21 05:10:00,004 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK] 2023-07-21 05:10:00,004 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK] 2023-07-21 05:10:00,020 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-21 05:10:00,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/WALs/jenkins-hbase4.apache.org,38519,1689916197810/jenkins-hbase4.apache.org%2C38519%2C1689916197810.1689916199927 2023-07-21 05:10:00,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK], DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK], DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK]] 2023-07-21 05:10:00,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:10:00,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:00,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,203 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,211 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-21 05:10:00,246 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-21 05:10:00,262 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:00,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:00,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68943835, jitterRate=0.027343198657035828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:00,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 05:10:00,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-21 05:10:00,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-21 05:10:00,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-21 05:10:00,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-21 05:10:00,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-21 05:10:00,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 46 msec 2023-07-21 05:10:00,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-21 05:10:00,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-21 05:10:00,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-21 05:10:00,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-21 05:10:00,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-21 05:10:00,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-21 05:10:00,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-21 05:10:00,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-21 05:10:00,515 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:00,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-21 05:10:00,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-21 05:10:00,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-21 05:10:00,538 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 05:10:00,538 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 05:10:00,538 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:00,538 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 05:10:00,538 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 05:10:00,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38519,1689916197810, sessionid=0x10186494aba0000, setting cluster-up flag (Was=false) 2023-07-21 05:10:00,566 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:00,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-21 05:10:00,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:10:00,584 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:00,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-21 05:10:00,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:10:00,596 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp 2023-07-21 05:10:00,690 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(951): ClusterId : a9f71380-5d9b-423a-b7ac-5e99a6e5ea07 2023-07-21 05:10:00,692 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(951): ClusterId : a9f71380-5d9b-423a-b7ac-5e99a6e5ea07 2023-07-21 05:10:00,707 INFO [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(951): ClusterId : a9f71380-5d9b-423a-b7ac-5e99a6e5ea07 2023-07-21 05:10:00,718 DEBUG [RS:2;jenkins-hbase4:36249] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 05:10:00,718 DEBUG [RS:0;jenkins-hbase4:39445] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 05:10:00,719 DEBUG [RS:1;jenkins-hbase4:46441] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 05:10:00,729 DEBUG [RS:0;jenkins-hbase4:39445] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 05:10:00,729 DEBUG [RS:2;jenkins-hbase4:36249] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 05:10:00,729 DEBUG [RS:2;jenkins-hbase4:36249] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 05:10:00,729 DEBUG [RS:0;jenkins-hbase4:39445] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 05:10:00,735 DEBUG [RS:1;jenkins-hbase4:46441] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 05:10:00,735 DEBUG [RS:1;jenkins-hbase4:46441] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 05:10:00,738 DEBUG [RS:2;jenkins-hbase4:36249] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 05:10:00,739 DEBUG [RS:0;jenkins-hbase4:39445] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 05:10:00,741 DEBUG [RS:2;jenkins-hbase4:36249] zookeeper.ReadOnlyZKClient(139): Connect 0x56b4d19a to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:00,742 DEBUG [RS:0;jenkins-hbase4:39445] zookeeper.ReadOnlyZKClient(139): Connect 0x34925bcb to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:00,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-21 05:10:00,744 DEBUG [RS:1;jenkins-hbase4:46441] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 05:10:00,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:00,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-21 05:10:00,761 DEBUG [RS:1;jenkins-hbase4:46441] zookeeper.ReadOnlyZKClient(139): Connect 0x60eff91a to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:00,791 DEBUG [RS:2;jenkins-hbase4:36249] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5873253c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:00,793 DEBUG [RS:2;jenkins-hbase4:36249] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c4cbaea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 05:10:00,797 DEBUG [RS:0;jenkins-hbase4:39445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a55b329, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:00,797 DEBUG [RS:0;jenkins-hbase4:39445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e6a30bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 05:10:00,841 DEBUG [RS:1;jenkins-hbase4:46441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e280b77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:00,842 DEBUG [RS:1;jenkins-hbase4:46441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f15014c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 05:10:00,862 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36249 2023-07-21 05:10:00,865 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46441 2023-07-21 05:10:00,870 INFO [RS:2;jenkins-hbase4:36249] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 05:10:00,870 INFO [RS:2;jenkins-hbase4:36249] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 05:10:00,870 INFO [RS:1;jenkins-hbase4:46441] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 05:10:00,872 INFO [RS:1;jenkins-hbase4:46441] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 05:10:00,872 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 05:10:00,873 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 05:10:00,874 INFO [RS:1;jenkins-hbase4:46441] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:00,874 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 05:10:00,873 INFO [RS:2;jenkins-hbase4:36249] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:00,875 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 05:10:00,878 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38519,1689916197810 with isa=jenkins-hbase4.apache.org/172.31.14.131:46441, startcode=1689916199266 2023-07-21 05:10:00,878 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39445 2023-07-21 05:10:00,878 INFO [RS:0;jenkins-hbase4:39445] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 05:10:00,878 INFO [RS:0;jenkins-hbase4:39445] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 05:10:00,879 INFO [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38519,1689916197810 with isa=jenkins-hbase4.apache.org/172.31.14.131:36249, startcode=1689916199318 2023-07-21 05:10:00,879 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 05:10:00,879 INFO [RS:0;jenkins-hbase4:39445] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:00,879 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 05:10:00,880 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38519,1689916197810 with isa=jenkins-hbase4.apache.org/172.31.14.131:39445, startcode=1689916199184 2023-07-21 05:10:00,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-21 05:10:00,904 DEBUG [RS:0;jenkins-hbase4:39445] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 05:10:00,905 DEBUG [RS:2;jenkins-hbase4:36249] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 05:10:00,904 DEBUG [RS:1;jenkins-hbase4:46441] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 05:10:00,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 05:10:00,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 05:10:00,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 05:10:00,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 05:10:00,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-21 05:10:00,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:00,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 05:10:00,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:00,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689916230931 2023-07-21 05:10:00,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-21 05:10:00,971 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 05:10:00,977 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-21 05:10:00,983 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:00,986 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34465, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 05:10:00,991 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53775, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 05:10:01,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-21 05:10:01,002 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37787, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 05:10:01,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-21 05:10:01,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-21 05:10:01,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-21 05:10:01,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-21 05:10:01,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,031 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38519] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 05:10:01,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-21 05:10:01,045 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38519] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 05:10:01,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-21 05:10:01,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-21 05:10:01,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-21 05:10:01,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-21 05:10:01,054 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38519] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 05:10:01,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689916201056,5,FailOnTimeoutGroup] 2023-07-21 05:10:01,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689916201056,5,FailOnTimeoutGroup] 2023-07-21 05:10:01,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-21 05:10:01,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,099 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 05:10:01,099 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 05:10:01,099 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 05:10:01,099 WARN [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 05:10:01,099 WARN [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 05:10:01,099 WARN [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 05:10:01,115 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:01,117 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:01,117 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:01,153 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:01,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 05:10:01,163 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/info 2023-07-21 05:10:01,164 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 05:10:01,165 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,166 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 05:10:01,171 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/rep_barrier 2023-07-21 05:10:01,172 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 05:10:01,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 05:10:01,176 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/table 2023-07-21 05:10:01,176 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 05:10:01,177 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,179 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740 2023-07-21 05:10:01,180 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740 2023-07-21 05:10:01,185 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 05:10:01,188 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 05:10:01,192 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:01,194 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64174131, jitterRate=-0.043730929493904114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 05:10:01,194 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 05:10:01,194 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 05:10:01,194 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 05:10:01,194 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 05:10:01,194 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 05:10:01,195 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 05:10:01,201 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38519,1689916197810 with isa=jenkins-hbase4.apache.org/172.31.14.131:39445, startcode=1689916199184 2023-07-21 05:10:01,201 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38519,1689916197810 with isa=jenkins-hbase4.apache.org/172.31.14.131:46441, startcode=1689916199266 2023-07-21 05:10:01,203 INFO [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38519,1689916197810 with isa=jenkins-hbase4.apache.org/172.31.14.131:36249, startcode=1689916199318 2023-07-21 05:10:01,211 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 05:10:01,211 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 05:10:01,214 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38519] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,218 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 05:10:01,218 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-21 05:10:01,221 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38519] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:01,222 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:01,223 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36811 2023-07-21 05:10:01,223 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 05:10:01,225 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:01,225 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36811 2023-07-21 05:10:01,225 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 05:10:01,225 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38519] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:01,227 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:01,227 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36811 2023-07-21 05:10:01,227 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 05:10:01,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-21 05:10:01,233 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:10:01,238 DEBUG [RS:0;jenkins-hbase4:39445] zookeeper.ZKUtil(162): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,239 DEBUG [RS:1;jenkins-hbase4:46441] zookeeper.ZKUtil(162): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:01,239 WARN [RS:0;jenkins-hbase4:39445] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 05:10:01,239 WARN [RS:1;jenkins-hbase4:46441] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 05:10:01,241 INFO [RS:1;jenkins-hbase4:46441] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:01,241 INFO [RS:0;jenkins-hbase4:39445] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:01,242 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:01,242 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,243 DEBUG [RS:2;jenkins-hbase4:36249] zookeeper.ZKUtil(162): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:01,244 WARN [RS:2;jenkins-hbase4:36249] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 05:10:01,244 INFO [RS:2;jenkins-hbase4:36249] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:01,244 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46441,1689916199266] 2023-07-21 05:10:01,244 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39445,1689916199184] 2023-07-21 05:10:01,244 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:01,244 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36249,1689916199318] 2023-07-21 05:10:01,255 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-21 05:10:01,261 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-21 05:10:01,271 DEBUG [RS:1;jenkins-hbase4:46441] zookeeper.ZKUtil(162): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:01,271 DEBUG [RS:0;jenkins-hbase4:39445] zookeeper.ZKUtil(162): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:01,271 DEBUG [RS:2;jenkins-hbase4:36249] zookeeper.ZKUtil(162): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:01,272 DEBUG [RS:1;jenkins-hbase4:46441] zookeeper.ZKUtil(162): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:01,272 DEBUG [RS:0;jenkins-hbase4:39445] zookeeper.ZKUtil(162): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:01,272 DEBUG [RS:2;jenkins-hbase4:36249] zookeeper.ZKUtil(162): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:01,272 DEBUG [RS:1;jenkins-hbase4:46441] zookeeper.ZKUtil(162): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,273 DEBUG [RS:0;jenkins-hbase4:39445] zookeeper.ZKUtil(162): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,273 DEBUG [RS:2;jenkins-hbase4:36249] zookeeper.ZKUtil(162): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,286 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 05:10:01,286 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 05:10:01,286 DEBUG [RS:2;jenkins-hbase4:36249] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 05:10:01,305 INFO [RS:2;jenkins-hbase4:36249] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 05:10:01,307 INFO [RS:0;jenkins-hbase4:39445] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 05:10:01,307 INFO [RS:1;jenkins-hbase4:46441] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 05:10:01,336 INFO [RS:0;jenkins-hbase4:39445] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 05:10:01,336 INFO [RS:2;jenkins-hbase4:36249] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 05:10:01,337 INFO [RS:1;jenkins-hbase4:46441] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 05:10:01,341 INFO [RS:1;jenkins-hbase4:46441] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 05:10:01,341 INFO [RS:1;jenkins-hbase4:46441] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,341 INFO [RS:2;jenkins-hbase4:36249] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 05:10:01,343 INFO [RS:0;jenkins-hbase4:39445] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 05:10:01,344 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 05:10:01,343 INFO [RS:2;jenkins-hbase4:36249] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,344 INFO [RS:0;jenkins-hbase4:39445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,346 INFO [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 05:10:01,346 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 05:10:01,357 INFO [RS:2;jenkins-hbase4:36249] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,357 INFO [RS:1;jenkins-hbase4:46441] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,358 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,357 INFO [RS:0;jenkins-hbase4:39445] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,358 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,358 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 05:10:01,359 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,360 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,360 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 05:10:01,360 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,359 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,360 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,360 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,360 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,360 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,360 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,361 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,361 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 05:10:01,361 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,361 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,361 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,362 DEBUG [RS:1;jenkins-hbase4:46441] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,361 DEBUG [RS:0;jenkins-hbase4:39445] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,360 DEBUG [RS:2;jenkins-hbase4:36249] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,369 INFO [RS:1;jenkins-hbase4:46441] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,369 INFO [RS:1;jenkins-hbase4:46441] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,369 INFO [RS:1;jenkins-hbase4:46441] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,370 INFO [RS:0;jenkins-hbase4:39445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,370 INFO [RS:0;jenkins-hbase4:39445] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,370 INFO [RS:0;jenkins-hbase4:39445] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,371 INFO [RS:2;jenkins-hbase4:36249] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,371 INFO [RS:2;jenkins-hbase4:36249] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,371 INFO [RS:2;jenkins-hbase4:36249] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,389 INFO [RS:0;jenkins-hbase4:39445] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 05:10:01,389 INFO [RS:2;jenkins-hbase4:36249] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 05:10:01,393 INFO [RS:0;jenkins-hbase4:39445] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39445,1689916199184-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,394 INFO [RS:2;jenkins-hbase4:36249] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36249,1689916199318-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,402 INFO [RS:1;jenkins-hbase4:46441] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 05:10:01,403 INFO [RS:1;jenkins-hbase4:46441] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46441,1689916199266-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,415 DEBUG [jenkins-hbase4:38519] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-21 05:10:01,424 DEBUG [jenkins-hbase4:38519] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:01,438 INFO [RS:0;jenkins-hbase4:39445] regionserver.Replication(203): jenkins-hbase4.apache.org,39445,1689916199184 started 2023-07-21 05:10:01,438 INFO [RS:2;jenkins-hbase4:36249] regionserver.Replication(203): jenkins-hbase4.apache.org,36249,1689916199318 started 2023-07-21 05:10:01,438 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39445,1689916199184, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39445, sessionid=0x10186494aba0001 2023-07-21 05:10:01,438 INFO [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36249,1689916199318, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36249, sessionid=0x10186494aba0003 2023-07-21 05:10:01,438 DEBUG [RS:2;jenkins-hbase4:36249] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 05:10:01,438 DEBUG [RS:0;jenkins-hbase4:39445] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 05:10:01,438 DEBUG [RS:2;jenkins-hbase4:36249] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:01,449 DEBUG [RS:2;jenkins-hbase4:36249] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36249,1689916199318' 2023-07-21 05:10:01,449 DEBUG [RS:2;jenkins-hbase4:36249] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 05:10:01,450 DEBUG [jenkins-hbase4:38519] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:01,450 DEBUG [jenkins-hbase4:38519] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:01,450 DEBUG [jenkins-hbase4:38519] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:01,450 DEBUG [jenkins-hbase4:38519] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:01,439 DEBUG [RS:0;jenkins-hbase4:39445] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,452 DEBUG [RS:2;jenkins-hbase4:36249] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 05:10:01,453 DEBUG [RS:0;jenkins-hbase4:39445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39445,1689916199184' 2023-07-21 05:10:01,454 DEBUG [RS:0;jenkins-hbase4:39445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 05:10:01,454 DEBUG [RS:2;jenkins-hbase4:36249] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 05:10:01,454 DEBUG [RS:2;jenkins-hbase4:36249] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 05:10:01,454 DEBUG [RS:2;jenkins-hbase4:36249] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:01,454 DEBUG [RS:2;jenkins-hbase4:36249] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36249,1689916199318' 2023-07-21 05:10:01,454 DEBUG [RS:0;jenkins-hbase4:39445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 05:10:01,454 DEBUG [RS:2;jenkins-hbase4:36249] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:01,455 DEBUG [RS:2;jenkins-hbase4:36249] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:01,455 DEBUG [RS:0;jenkins-hbase4:39445] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 05:10:01,455 DEBUG [RS:0;jenkins-hbase4:39445] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 05:10:01,455 DEBUG [RS:0;jenkins-hbase4:39445] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,456 DEBUG [RS:0;jenkins-hbase4:39445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39445,1689916199184' 2023-07-21 05:10:01,456 DEBUG [RS:0;jenkins-hbase4:39445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:01,456 DEBUG [RS:0;jenkins-hbase4:39445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:01,456 DEBUG [RS:2;jenkins-hbase4:36249] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 05:10:01,457 INFO [RS:2;jenkins-hbase4:36249] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 05:10:01,457 INFO [RS:2;jenkins-hbase4:36249] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 05:10:01,457 DEBUG [RS:0;jenkins-hbase4:39445] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 05:10:01,457 INFO [RS:0;jenkins-hbase4:39445] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 05:10:01,459 INFO [RS:0;jenkins-hbase4:39445] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 05:10:01,461 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39445,1689916199184, state=OPENING 2023-07-21 05:10:01,464 INFO [RS:1;jenkins-hbase4:46441] regionserver.Replication(203): jenkins-hbase4.apache.org,46441,1689916199266 started 2023-07-21 05:10:01,464 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46441,1689916199266, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46441, sessionid=0x10186494aba0002 2023-07-21 05:10:01,464 DEBUG [RS:1;jenkins-hbase4:46441] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 05:10:01,464 DEBUG [RS:1;jenkins-hbase4:46441] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:01,464 DEBUG [RS:1;jenkins-hbase4:46441] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46441,1689916199266' 2023-07-21 05:10:01,464 DEBUG [RS:1;jenkins-hbase4:46441] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 05:10:01,465 DEBUG [RS:1;jenkins-hbase4:46441] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 05:10:01,466 DEBUG [RS:1;jenkins-hbase4:46441] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 05:10:01,466 DEBUG [RS:1;jenkins-hbase4:46441] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 05:10:01,466 DEBUG [RS:1;jenkins-hbase4:46441] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:01,466 DEBUG [RS:1;jenkins-hbase4:46441] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46441,1689916199266' 2023-07-21 05:10:01,466 DEBUG [RS:1;jenkins-hbase4:46441] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:01,466 DEBUG [RS:1;jenkins-hbase4:46441] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:01,468 DEBUG [RS:1;jenkins-hbase4:46441] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 05:10:01,468 INFO [RS:1;jenkins-hbase4:46441] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 05:10:01,468 INFO [RS:1;jenkins-hbase4:46441] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 05:10:01,473 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-21 05:10:01,475 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:01,476 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 05:10:01,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:10:01,574 INFO [RS:0;jenkins-hbase4:39445] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39445%2C1689916199184, suffix=, logDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,39445,1689916199184, archiveDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/oldWALs, maxLogs=32 2023-07-21 05:10:01,575 INFO [RS:1;jenkins-hbase4:46441] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46441%2C1689916199266, suffix=, logDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,46441,1689916199266, archiveDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/oldWALs, maxLogs=32 2023-07-21 05:10:01,580 INFO [RS:2;jenkins-hbase4:36249] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36249%2C1689916199318, suffix=, logDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,36249,1689916199318, archiveDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/oldWALs, maxLogs=32 2023-07-21 05:10:01,607 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK] 2023-07-21 05:10:01,607 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK] 2023-07-21 05:10:01,609 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK] 2023-07-21 05:10:01,619 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK] 2023-07-21 05:10:01,620 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK] 2023-07-21 05:10:01,620 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK] 2023-07-21 05:10:01,630 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK] 2023-07-21 05:10:01,630 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK] 2023-07-21 05:10:01,630 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK] 2023-07-21 05:10:01,632 INFO [RS:0;jenkins-hbase4:39445] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,39445,1689916199184/jenkins-hbase4.apache.org%2C39445%2C1689916199184.1689916201578 2023-07-21 05:10:01,633 DEBUG [RS:0;jenkins-hbase4:39445] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK], DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK], DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK]] 2023-07-21 05:10:01,641 INFO [RS:1;jenkins-hbase4:46441] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,46441,1689916199266/jenkins-hbase4.apache.org%2C46441%2C1689916199266.1689916201578 2023-07-21 05:10:01,642 INFO [RS:2;jenkins-hbase4:36249] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,36249,1689916199318/jenkins-hbase4.apache.org%2C36249%2C1689916199318.1689916201582 2023-07-21 05:10:01,642 DEBUG [RS:1;jenkins-hbase4:46441] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK], DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK], DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK]] 2023-07-21 05:10:01,644 DEBUG [RS:2;jenkins-hbase4:36249] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK], DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK], DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK]] 2023-07-21 05:10:01,681 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:01,684 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:10:01,687 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:10:01,719 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-21 05:10:01,721 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:01,726 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39445%2C1689916199184.meta, suffix=.meta, logDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,39445,1689916199184, archiveDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/oldWALs, maxLogs=32 2023-07-21 05:10:01,756 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK] 2023-07-21 05:10:01,757 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK] 2023-07-21 05:10:01,758 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK] 2023-07-21 05:10:01,774 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/WALs/jenkins-hbase4.apache.org,39445,1689916199184/jenkins-hbase4.apache.org%2C39445%2C1689916199184.meta.1689916201728.meta 2023-07-21 05:10:01,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35959,DS-048cd3c1-c05b-4ea5-8ac7-3a214b930a52,DISK], DatanodeInfoWithStorage[127.0.0.1:33623,DS-678e7a63-519d-4292-a8e9-a4194e234e49,DISK], DatanodeInfoWithStorage[127.0.0.1:40267,DS-87a08720-36b2-41ae-81df-11c3d97547e3,DISK]] 2023-07-21 05:10:01,780 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:10:01,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-21 05:10:01,783 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:01,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-21 05:10:01,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-21 05:10:01,787 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-21 05:10:01,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-21 05:10:01,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:01,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-21 05:10:01,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-21 05:10:01,806 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 05:10:01,808 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/info 2023-07-21 05:10:01,809 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/info 2023-07-21 05:10:01,809 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 05:10:01,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 05:10:01,812 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/rep_barrier 2023-07-21 05:10:01,812 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/rep_barrier 2023-07-21 05:10:01,813 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 05:10:01,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 05:10:01,815 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/table 2023-07-21 05:10:01,815 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/table 2023-07-21 05:10:01,816 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 05:10:01,817 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740 2023-07-21 05:10:01,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740 2023-07-21 05:10:01,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 05:10:01,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 05:10:01,830 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69324048, jitterRate=0.03300881385803223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 05:10:01,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 05:10:01,844 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689916201672 2023-07-21 05:10:01,864 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-21 05:10:01,865 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-21 05:10:01,866 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39445,1689916199184, state=OPEN 2023-07-21 05:10:01,874 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-21 05:10:01,874 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 05:10:01,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-21 05:10:01,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39445,1689916199184 in 394 msec 2023-07-21 05:10:01,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-21 05:10:01,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 654 msec 2023-07-21 05:10:01,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1340 sec 2023-07-21 05:10:01,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689916201905, completionTime=-1 2023-07-21 05:10:01,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-21 05:10:01,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-21 05:10:01,987 DEBUG [hconnection-0x520f41b4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:01,994 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:02,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-21 05:10:02,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689916262023 2023-07-21 05:10:02,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689916322023 2023-07-21 05:10:02,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 118 msec 2023-07-21 05:10:02,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38519,1689916197810-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38519,1689916197810-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38519,1689916197810-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38519, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,099 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-21 05:10:02,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-21 05:10:02,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:02,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-21 05:10:02,131 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:02,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:02,166 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,169 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed empty. 2023-07-21 05:10:02,170 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,170 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-21 05:10:02,219 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:02,222 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c465e3321f42730c1e28c4b4da3540ed, NAME => 'hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:10:02,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:02,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c465e3321f42730c1e28c4b4da3540ed, disabling compactions & flushes 2023-07-21 05:10:02,253 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:10:02,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:10:02,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. after waiting 0 ms 2023-07-21 05:10:02,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:10:02,254 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:10:02,254 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c465e3321f42730c1e28c4b4da3540ed: 2023-07-21 05:10:02,259 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:02,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689916202263"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916202263"}]},"ts":"1689916202263"} 2023-07-21 05:10:02,315 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 05:10:02,320 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:02,325 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916202320"}]},"ts":"1689916202320"} 2023-07-21 05:10:02,329 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-21 05:10:02,335 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:02,337 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:02,337 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:02,337 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:02,337 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:02,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c465e3321f42730c1e28c4b4da3540ed, ASSIGN}] 2023-07-21 05:10:02,342 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c465e3321f42730c1e28c4b4da3540ed, ASSIGN 2023-07-21 05:10:02,345 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c465e3321f42730c1e28c4b4da3540ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39445,1689916199184; forceNewPlan=false, retain=false 2023-07-21 05:10:02,500 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 05:10:02,501 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c465e3321f42730c1e28c4b4da3540ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:02,501 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689916202500"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916202500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916202500"}]},"ts":"1689916202500"} 2023-07-21 05:10:02,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c465e3321f42730c1e28c4b4da3540ed, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:10:02,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:10:02,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c465e3321f42730c1e28c4b4da3540ed, NAME => 'hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed.', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:10:02,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. service=AccessControlService 2023-07-21 05:10:02,672 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:02,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:02,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,676 INFO [StoreOpener-c465e3321f42730c1e28c4b4da3540ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,678 DEBUG [StoreOpener-c465e3321f42730c1e28c4b4da3540ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed/info 2023-07-21 05:10:02,679 DEBUG [StoreOpener-c465e3321f42730c1e28c4b4da3540ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed/info 2023-07-21 05:10:02,679 INFO [StoreOpener-c465e3321f42730c1e28c4b4da3540ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c465e3321f42730c1e28c4b4da3540ed columnFamilyName info 2023-07-21 05:10:02,680 INFO [StoreOpener-c465e3321f42730c1e28c4b4da3540ed-1] regionserver.HStore(310): Store=c465e3321f42730c1e28c4b4da3540ed/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:02,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,688 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:10:02,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:02,693 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c465e3321f42730c1e28c4b4da3540ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60518398, jitterRate=-0.09820559620857239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:02,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c465e3321f42730c1e28c4b4da3540ed: 2023-07-21 05:10:02,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed., pid=6, masterSystemTime=1689916202660 2023-07-21 05:10:02,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:10:02,699 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:10:02,701 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c465e3321f42730c1e28c4b4da3540ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:02,701 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689916202701"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916202701"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916202701"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916202701"}]},"ts":"1689916202701"} 2023-07-21 05:10:02,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-21 05:10:02,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c465e3321f42730c1e28c4b4da3540ed, server=jenkins-hbase4.apache.org,39445,1689916199184 in 199 msec 2023-07-21 05:10:02,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-21 05:10:02,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c465e3321f42730c1e28c4b4da3540ed, ASSIGN in 370 msec 2023-07-21 05:10:02,715 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:02,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916202716"}]},"ts":"1689916202716"} 2023-07-21 05:10:02,718 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-21 05:10:02,722 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:02,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 607 msec 2023-07-21 05:10:02,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-21 05:10:02,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-21 05:10:02,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:02,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-21 05:10:02,789 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 05:10:02,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 44 msec 2023-07-21 05:10:02,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-21 05:10:02,832 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 05:10:02,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 26 msec 2023-07-21 05:10:02,863 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-21 05:10:02,865 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-21 05:10:02,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.449sec 2023-07-21 05:10:02,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-21 05:10:02,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-21 05:10:02,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-21 05:10:02,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38519,1689916197810-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-21 05:10:02,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38519,1689916197810-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-21 05:10:02,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:02,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-21 05:10:02,911 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:02,916 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:02,916 DEBUG [Listener at localhost/36037] zookeeper.ReadOnlyZKClient(139): Connect 0x172f6466 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:02,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-21 05:10:02,931 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:02,932 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7 empty. 2023-07-21 05:10:02,935 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:02,935 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-21 05:10:02,937 DEBUG [Listener at localhost/36037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@108031b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:02,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:02,971 DEBUG [hconnection-0x1c899b85-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:03,006 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:03,009 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:03,010 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:10:03,010 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-21 05:10:03,010 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/test.cache.data in system properties and HBase conf 2023-07-21 05:10:03,010 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 05:10:03,011 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop.log.dir in system properties and HBase conf 2023-07-21 05:10:03,011 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 05:10:03,011 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 05:10:03,011 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 05:10:03,011 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 05:10:03,011 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 05:10:03,011 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 05:10:03,012 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 05:10:03,012 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 05:10:03,012 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => db1146cd61caeaf377a85879b445d9a7, NAME => 'hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:10:03,012 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 05:10:03,012 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 05:10:03,012 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 05:10:03,012 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 05:10:03,012 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/nfs.dump.dir in system properties and HBase conf 2023-07-21 05:10:03,013 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir in system properties and HBase conf 2023-07-21 05:10:03,013 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 05:10:03,013 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 05:10:03,013 INFO [Listener at localhost/36037] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-21 05:10:03,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:03,058 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:03,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing db1146cd61caeaf377a85879b445d9a7, disabling compactions & flushes 2023-07-21 05:10:03,059 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:10:03,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:10:03,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. after waiting 0 ms 2023-07-21 05:10:03,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:10:03,059 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:10:03,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for db1146cd61caeaf377a85879b445d9a7: 2023-07-21 05:10:03,070 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:03,072 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689916203071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916203071"}]},"ts":"1689916203071"} 2023-07-21 05:10:03,080 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 05:10:03,083 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:03,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916203083"}]},"ts":"1689916203083"} 2023-07-21 05:10:03,131 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-21 05:10:03,138 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:03,141 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:03,141 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:03,141 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:03,141 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:03,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=db1146cd61caeaf377a85879b445d9a7, ASSIGN}] 2023-07-21 05:10:03,145 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=db1146cd61caeaf377a85879b445d9a7, ASSIGN 2023-07-21 05:10:03,147 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=db1146cd61caeaf377a85879b445d9a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46441,1689916199266; forceNewPlan=false, retain=false 2023-07-21 05:10:03,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:03,298 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 05:10:03,301 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=db1146cd61caeaf377a85879b445d9a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:03,301 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689916203300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916203300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916203300"}]},"ts":"1689916203300"} 2023-07-21 05:10:03,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure db1146cd61caeaf377a85879b445d9a7, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:10:03,466 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:03,467 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:10:03,473 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:10:03,481 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:10:03,482 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db1146cd61caeaf377a85879b445d9a7, NAME => 'hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7.', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:10:03,482 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. service=AccessControlService 2023-07-21 05:10:03,482 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:03,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:03,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:03,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:03,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:03,487 INFO [StoreOpener-db1146cd61caeaf377a85879b445d9a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:03,492 DEBUG [StoreOpener-db1146cd61caeaf377a85879b445d9a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7/l 2023-07-21 05:10:03,492 DEBUG [StoreOpener-db1146cd61caeaf377a85879b445d9a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7/l 2023-07-21 05:10:03,493 INFO [StoreOpener-db1146cd61caeaf377a85879b445d9a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db1146cd61caeaf377a85879b445d9a7 columnFamilyName l 2023-07-21 05:10:03,494 INFO [StoreOpener-db1146cd61caeaf377a85879b445d9a7-1] regionserver.HStore(310): Store=db1146cd61caeaf377a85879b445d9a7/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:03,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:03,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:03,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:10:03,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:03,520 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db1146cd61caeaf377a85879b445d9a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60945507, jitterRate=-0.09184117615222931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:03,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db1146cd61caeaf377a85879b445d9a7: 2023-07-21 05:10:03,532 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7., pid=11, masterSystemTime=1689916203463 2023-07-21 05:10:03,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:10:03,541 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=db1146cd61caeaf377a85879b445d9a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:03,541 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689916203541"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916203541"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916203541"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916203541"}]},"ts":"1689916203541"} 2023-07-21 05:10:03,545 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:10:03,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-21 05:10:03,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure db1146cd61caeaf377a85879b445d9a7, server=jenkins-hbase4.apache.org,46441,1689916199266 in 239 msec 2023-07-21 05:10:03,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-21 05:10:03,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:03,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=db1146cd61caeaf377a85879b445d9a7, ASSIGN in 409 msec 2023-07-21 05:10:03,567 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:03,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916203567"}]},"ts":"1689916203567"} 2023-07-21 05:10:03,571 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-21 05:10:03,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:03,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 668 msec 2023-07-21 05:10:04,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:04,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-21 05:10:04,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-21 05:10:04,589 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:10:04,947 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:10:04,953 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34203_jobhistory____.l33llv/webapp 2023-07-21 05:10:05,154 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-21 05:10:05,154 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-21 05:10:05,154 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 05:10:05,158 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 05:10:05,254 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:05,611 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:06,002 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-21 05:10:06,083 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34203 2023-07-21 05:10:07,353 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:10:07,664 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-21 05:10:07,666 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-21 05:10:07,667 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-21 05:10:07,697 WARN [Listener at jenkins-hbase4.apache.org/36103] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:10:07,824 WARN [Listener at jenkins-hbase4.apache.org/36103] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 05:10:07,825 INFO [Listener at jenkins-hbase4.apache.org/36103] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:10:07,846 INFO [Listener at jenkins-hbase4.apache.org/36103] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44445_cluster____oe4rwv/webapp 2023-07-21 05:10:07,949 INFO [Listener at jenkins-hbase4.apache.org/36103] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 05:10:07,950 INFO [Listener at jenkins-hbase4.apache.org/36103] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-21 05:10:07,950 INFO [Listener at jenkins-hbase4.apache.org/36103] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 05:10:07,951 INFO [Listener at jenkins-hbase4.apache.org/36103] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 05:10:07,963 INFO [Listener at jenkins-hbase4.apache.org/36103] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:07,991 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:07,992 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-21 05:10:07,992 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:07,992 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-21 05:10:07,993 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 05:10:07,993 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-21 05:10:07,993 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:07,993 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-21 05:10:07,993 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 05:10:07,993 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-21 05:10:08,178 INFO [Listener at jenkins-hbase4.apache.org/36103] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:08,299 INFO [Listener at jenkins-hbase4.apache.org/36103] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:08,314 INFO [Listener at jenkins-hbase4.apache.org/36103] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44445 2023-07-21 05:10:08,887 WARN [Listener at jenkins-hbase4.apache.org/38739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:10:08,916 WARN [Listener at jenkins-hbase4.apache.org/38739] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 05:10:08,917 INFO [Listener at jenkins-hbase4.apache.org/38739] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:10:08,927 INFO [Listener at jenkins-hbase4.apache.org/38739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33927_node____12vv30/webapp 2023-07-21 05:10:08,983 INFO [Listener at jenkins-hbase4.apache.org/38739] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 05:10:08,983 INFO [Listener at jenkins-hbase4.apache.org/38739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 05:10:08,983 INFO [Listener at jenkins-hbase4.apache.org/38739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 05:10:08,984 INFO [Listener at jenkins-hbase4.apache.org/38739] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 05:10:08,995 INFO [Listener at jenkins-hbase4.apache.org/38739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,022 INFO [Listener at jenkins-hbase4.apache.org/38739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,105 INFO [Listener at jenkins-hbase4.apache.org/38739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,127 INFO [Listener at jenkins-hbase4.apache.org/38739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33927 2023-07-21 05:10:09,434 WARN [Listener at jenkins-hbase4.apache.org/37521] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:10:09,440 WARN [Listener at jenkins-hbase4.apache.org/37521] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 05:10:09,441 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:10:09,452 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46087_node____.xiylat/webapp 2023-07-21 05:10:09,519 INFO [Listener at jenkins-hbase4.apache.org/37521] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 05:10:09,519 INFO [Listener at jenkins-hbase4.apache.org/37521] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 05:10:09,519 INFO [Listener at jenkins-hbase4.apache.org/37521] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 05:10:09,519 INFO [Listener at jenkins-hbase4.apache.org/37521] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 05:10:09,529 INFO [Listener at jenkins-hbase4.apache.org/37521] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,547 INFO [Listener at jenkins-hbase4.apache.org/37521] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,622 INFO [Listener at jenkins-hbase4.apache.org/37521] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,629 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46087 2023-07-21 05:10:09,663 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-21 05:10:09,665 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:09,740 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=382, ProcessCount=177, AvailableMemoryMB=4416 2023-07-21 05:10:09,740 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-07-21 05:10:09,755 DEBUG [Listener at jenkins-hbase4.apache.org/37521] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 05:10:09,763 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-21 05:10:09,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:09,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:09,776 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:09,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-21 05:10:09,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:09,779 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:09,784 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:09,784 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:09,785 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38 empty. 2023-07-21 05:10:09,785 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73 empty. 2023-07-21 05:10:09,787 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:09,788 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:09,788 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 05:10:09,817 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:09,819 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 18438ba5b441f68c5138432b0c85bf73, NAME => 'testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:10:09,819 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => dd2d7e75feeacff9e4ddafc6ae6aca38, NAME => 'testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:10:09,855 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:09,858 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing dd2d7e75feeacff9e4ddafc6ae6aca38, disabling compactions & flushes 2023-07-21 05:10:09,858 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:09,858 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:09,858 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. after waiting 0 ms 2023-07-21 05:10:09,858 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:09,858 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:09,858 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:09,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 18438ba5b441f68c5138432b0c85bf73, disabling compactions & flushes 2023-07-21 05:10:09,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for dd2d7e75feeacff9e4ddafc6ae6aca38: 2023-07-21 05:10:09,859 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:09,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:09,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. after waiting 0 ms 2023-07-21 05:10:09,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:09,859 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:09,860 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 18438ba5b441f68c5138432b0c85bf73: 2023-07-21 05:10:09,864 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:09,865 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916209865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916209865"}]},"ts":"1689916209865"} 2023-07-21 05:10:09,865 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916209865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916209865"}]},"ts":"1689916209865"} 2023-07-21 05:10:09,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:09,926 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:10:09,928 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:09,928 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916209928"}]},"ts":"1689916209928"} 2023-07-21 05:10:09,933 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-21 05:10:09,938 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:09,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:09,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:09,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:09,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:09,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=18438ba5b441f68c5138432b0c85bf73, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd2d7e75feeacff9e4ddafc6ae6aca38, ASSIGN}] 2023-07-21 05:10:09,943 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd2d7e75feeacff9e4ddafc6ae6aca38, ASSIGN 2023-07-21 05:10:09,944 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=18438ba5b441f68c5138432b0c85bf73, ASSIGN 2023-07-21 05:10:09,945 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd2d7e75feeacff9e4ddafc6ae6aca38, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36249,1689916199318; forceNewPlan=false, retain=false 2023-07-21 05:10:09,945 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=18438ba5b441f68c5138432b0c85bf73, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39445,1689916199184; forceNewPlan=false, retain=false 2023-07-21 05:10:10,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:10,096 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:10:10,098 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dd2d7e75feeacff9e4ddafc6ae6aca38, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:10,098 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=18438ba5b441f68c5138432b0c85bf73, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:10,098 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916210098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916210098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916210098"}]},"ts":"1689916210098"} 2023-07-21 05:10:10,098 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916210098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916210098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916210098"}]},"ts":"1689916210098"} 2023-07-21 05:10:10,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure dd2d7e75feeacff9e4ddafc6ae6aca38, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:10:10,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 18438ba5b441f68c5138432b0c85bf73, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:10:10,255 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:10,256 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:10:10,259 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:10:10,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:10,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:10,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd2d7e75feeacff9e4ddafc6ae6aca38, NAME => 'testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:10:10,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18438ba5b441f68c5138432b0c85bf73, NAME => 'testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:10:10,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. service=AccessControlService 2023-07-21 05:10:10,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. service=AccessControlService 2023-07-21 05:10:10,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:10,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:10,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:10,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:10,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:10,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:10,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:10,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:10,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:10,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:10,269 INFO [StoreOpener-dd2d7e75feeacff9e4ddafc6ae6aca38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:10,269 INFO [StoreOpener-18438ba5b441f68c5138432b0c85bf73-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:10,271 DEBUG [StoreOpener-18438ba5b441f68c5138432b0c85bf73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf 2023-07-21 05:10:10,271 DEBUG [StoreOpener-18438ba5b441f68c5138432b0c85bf73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf 2023-07-21 05:10:10,271 DEBUG [StoreOpener-dd2d7e75feeacff9e4ddafc6ae6aca38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf 2023-07-21 05:10:10,271 DEBUG [StoreOpener-dd2d7e75feeacff9e4ddafc6ae6aca38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf 2023-07-21 05:10:10,271 INFO [StoreOpener-18438ba5b441f68c5138432b0c85bf73-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18438ba5b441f68c5138432b0c85bf73 columnFamilyName cf 2023-07-21 05:10:10,271 INFO [StoreOpener-dd2d7e75feeacff9e4ddafc6ae6aca38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd2d7e75feeacff9e4ddafc6ae6aca38 columnFamilyName cf 2023-07-21 05:10:10,272 INFO [StoreOpener-dd2d7e75feeacff9e4ddafc6ae6aca38-1] regionserver.HStore(310): Store=dd2d7e75feeacff9e4ddafc6ae6aca38/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:10,272 INFO [StoreOpener-18438ba5b441f68c5138432b0c85bf73-1] regionserver.HStore(310): Store=18438ba5b441f68c5138432b0c85bf73/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:10,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:10,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:10,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:10,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:10,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:10,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:10,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:10,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:10,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd2d7e75feeacff9e4ddafc6ae6aca38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61470746, jitterRate=-0.08401450514793396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:10,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd2d7e75feeacff9e4ddafc6ae6aca38: 2023-07-21 05:10:10,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18438ba5b441f68c5138432b0c85bf73; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67644736, jitterRate=0.007985115051269531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:10,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18438ba5b441f68c5138432b0c85bf73: 2023-07-21 05:10:10,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38., pid=15, masterSystemTime=1689916210255 2023-07-21 05:10:10,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73., pid=16, masterSystemTime=1689916210257 2023-07-21 05:10:10,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:10,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:10,297 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dd2d7e75feeacff9e4ddafc6ae6aca38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:10,298 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916210297"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916210297"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916210297"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916210297"}]},"ts":"1689916210297"} 2023-07-21 05:10:10,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:10,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:10,299 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=18438ba5b441f68c5138432b0c85bf73, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:10,300 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916210299"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916210299"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916210299"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916210299"}]},"ts":"1689916210299"} 2023-07-21 05:10:10,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-21 05:10:10,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure dd2d7e75feeacff9e4ddafc6ae6aca38, server=jenkins-hbase4.apache.org,36249,1689916199318 in 200 msec 2023-07-21 05:10:10,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-21 05:10:10,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 18438ba5b441f68c5138432b0c85bf73, server=jenkins-hbase4.apache.org,39445,1689916199184 in 199 msec 2023-07-21 05:10:10,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd2d7e75feeacff9e4ddafc6ae6aca38, ASSIGN in 364 msec 2023-07-21 05:10:10,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-21 05:10:10,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=18438ba5b441f68c5138432b0c85bf73, ASSIGN in 365 msec 2023-07-21 05:10:10,311 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:10,311 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916210311"}]},"ts":"1689916210311"} 2023-07-21 05:10:10,312 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-21 05:10:10,315 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:10,321 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-21 05:10:10,325 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:10,328 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:10,332 DEBUG [hconnection-0x1a9b3328-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:10,335 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-21 05:10:10,343 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 05:10:10,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:10,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:10,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:10,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:10,382 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:10,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:10,393 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:10,393 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:10,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:10,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:10,397 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:10,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 624 msec 2023-07-21 05:10:10,409 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:10,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:10,888 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-21 05:10:10,889 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-21 05:10:10,890 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:10,895 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-21 05:10:10,896 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:10,896 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-21 05:10:10,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:10,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916210911 (current time:1689916210911). 2023-07-21 05:10:10,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:10,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x022dd317 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:10,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b433943, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:10,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:10,924 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:10,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x022dd317 to 127.0.0.1:53187 2023-07-21 05:10:10,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:10,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x24ded3dd to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:10,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61832cd5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:10,939 DEBUG [hconnection-0x6e6236d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:10,940 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:10,946 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:10,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24ded3dd to 127.0.0.1:53187 2023-07-21 05:10:10,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:10,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 05:10:10,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:10,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:10,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:10,995 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:10,996 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689916810996 2023-07-21 05:10:10,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:10,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 05:10:11,000 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,005 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:11,005 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:11,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-21 05:10:11,010 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,011 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689916811011 2023-07-21 05:10:11,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,042 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-21 05:10:11,043 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,044 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 05:10:11,044 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 05:10:11,044 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,044 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,051 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,051 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,051 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,052 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,052 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,052 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 05:10:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 05:10:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,054 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,054 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,054 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,054 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:11,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 05:10:11,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,074 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,074 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,074 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,076 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,077 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,077 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,077 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,077 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,078 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,077 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,078 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,078 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,078 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,078 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 05:10:11,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096934[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 05:10:11,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096934[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:11,090 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 05:10:11,090 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,095 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:11,095 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,095 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,096 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,096 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:11,095 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:10:11,096 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:11,104 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,104 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:11,106 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:11,106 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. started... 2023-07-21 05:10:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:11,106 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. started... 2023-07-21 05:10:11,111 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd2d7e75feeacff9e4ddafc6ae6aca38: 2023-07-21 05:10:11,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:11,111 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18438ba5b441f68c5138432b0c85bf73: 2023-07-21 05:10:11,113 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,113 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:11,114 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:11,119 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:11,119 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:11,124 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:11,124 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:11,178 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. completed. 2023-07-21 05:10:11,178 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:10:11,182 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,182 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,182 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,182 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. completed. 2023-07-21 05:10:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,182 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:11,183 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:11,183 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:10:11,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,185 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,185 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:11,185 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,185 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:11,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39445,1689916199184': 2023-07-21 05:10:11,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 05:10:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:10:11,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 05:10:11,194 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-21 05:10:11,194 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:11,194 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:11,194 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,194 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:11,197 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,197 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,197 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,197 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,199 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,199 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,200 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,203 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,203 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,204 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,219 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,219 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,219 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,219 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,220 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,219 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,219 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,220 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,220 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,220 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,220 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,220 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,221 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,221 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,221 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,221 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,222 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,223 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,314 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:11,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:11,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:11,316 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:11,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 05:10:11,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,338 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689916210997Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689916211221 (+224 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689916211221Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689916211244 (+23 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689916211265 (+21 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689916211338 (+73 ms) 2023-07-21 05:10:11,346 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 348 msec 2023-07-21 05:10:11,616 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:11,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:11,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:11,646 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39445] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:11,653 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36249] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:11,660 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 05:10:11,661 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:11,663 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:11,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916211694 (current time:1689916211694). 2023-07-21 05:10:11,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:11,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x2522e609 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:11,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46013a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:11,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,705 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2522e609 to 127.0.0.1:53187 2023-07-21 05:10:11,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:11,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x4201ca4c to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:11,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70a16eab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:11,713 DEBUG [hconnection-0x7458be3a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,715 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,721 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4201ca4c to 127.0.0.1:53187 2023-07-21 05:10:11,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:11,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 05:10:11,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:11,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,726 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,728 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689916811728 2023-07-21 05:10:11,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 05:10:11,729 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:11,729 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:11,730 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-07-21 05:10:11,732 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,733 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689916811733 2023-07-21 05:10:11,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-21 05:10:11,748 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-21 05:10:11,748 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,749 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 05:10:11,749 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 05:10:11,750 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,750 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,751 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,751 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,751 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,751 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,752 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,752 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,752 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,752 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 05:10:11,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 05:10:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 05:10:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,756 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,756 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,756 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,756 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,757 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,759 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,759 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,759 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,760 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 05:10:11,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a19f258[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 05:10:11,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a19f258[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:11,765 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 05:10:11,765 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:11,772 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:10:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:11,773 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:11,773 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. started... 2023-07-21 05:10:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:11,773 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,773 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:11,773 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:11,773 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18438ba5b441f68c5138432b0c85bf73 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-21 05:10:11,773 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. started... 2023-07-21 05:10:11,774 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dd2d7e75feeacff9e4ddafc6ae6aca38 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-21 05:10:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:11,829 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:11,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:11,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:11,831 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:11,867 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/.tmp/cf/020cdc93ad554e4792d268a29056ff0e 2023-07-21 05:10:11,912 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/.tmp/cf/020cdc93ad554e4792d268a29056ff0e as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf/020cdc93ad554e4792d268a29056ff0e 2023-07-21 05:10:11,921 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf/020cdc93ad554e4792d268a29056ff0e, entries=5, sequenceid=6, filesize=5.2 K 2023-07-21 05:10:11,924 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 18438ba5b441f68c5138432b0c85bf73 in 151ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:11,924 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-21 05:10:11,924 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18438ba5b441f68c5138432b0c85bf73: 2023-07-21 05:10:11,925 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:11,925 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:11,925 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf/020cdc93ad554e4792d268a29056ff0e] hfiles 2023-07-21 05:10:11,925 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf/020cdc93ad554e4792d268a29056ff0e for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:11,944 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. completed. 2023-07-21 05:10:11,944 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:11,944 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:11,945 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:11,945 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,945 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:11,945 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:10:11,947 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,947 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:11,948 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,948 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39445,1689916199184': 2023-07-21 05:10:11,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 05:10:12,031 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:12,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:12,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:12,033 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:12,268 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/.tmp/cf/db4aa9a7fda340e2858d54fe01d2ff38 2023-07-21 05:10:12,278 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/.tmp/cf/db4aa9a7fda340e2858d54fe01d2ff38 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf/db4aa9a7fda340e2858d54fe01d2ff38 2023-07-21 05:10:12,287 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf/db4aa9a7fda340e2858d54fe01d2ff38, entries=45, sequenceid=6, filesize=7.9 K 2023-07-21 05:10:12,290 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for dd2d7e75feeacff9e4ddafc6ae6aca38 in 516ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:12,291 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd2d7e75feeacff9e4ddafc6ae6aca38: 2023-07-21 05:10:12,292 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:12,292 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:12,292 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf/db4aa9a7fda340e2858d54fe01d2ff38] hfiles 2023-07-21 05:10:12,292 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf/db4aa9a7fda340e2858d54fe01d2ff38 for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:12,313 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. completed. 2023-07-21 05:10:12,313 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:12,313 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:12,317 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:12,317 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,317 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:12,318 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:10:12,320 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,320 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:12,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:12,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:12,321 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:12,321 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:12,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:12,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:12,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:12,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:10:12,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 05:10:12,327 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-21 05:10:12,328 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:12,328 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:12,328 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-21 05:10:12,328 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:12,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:12,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,332 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,332 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:12,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,333 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,333 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:12,334 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:12,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:12,335 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 05:10:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:12,336 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,336 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:12,337 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:12,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:12,349 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,349 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:12,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,350 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,350 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-21 05:10:12,350 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:12,350 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,350 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,350 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:12,350 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,350 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,350 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-21 05:10:12,351 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,351 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,351 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:12,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,351 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,352 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:12,352 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:12,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,352 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,352 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 05:10:12,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,480 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689916211728Consolidate snapshot: snaptb0-testExportWithTargetName at 1689916212350 (+622 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689916212351 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689916212369 (+18 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689916212402 (+33 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689916212479 (+77 ms) 2023-07-21 05:10:12,483 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:12,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 754 msec 2023-07-21 05:10:12,835 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:12,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:12,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:12,839 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839 2023-07-21 05:10:12,839 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36811, tgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839, rawTgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839, srcFsUri=hdfs://localhost:36811, srcDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:12,886 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:12,886 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-902363965_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 05:10:12,886 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab, snapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-21 05:10:12,906 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 05:10:12,979 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:12,980 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:12,981 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:12,981 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,045 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-3686790547312464229.jar 2023-07-21 05:10:14,045 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,046 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,120 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-4323709778100799615.jar 2023-07-21 05:10:14,121 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,121 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,122 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,123 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,123 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,124 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:14,124 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:10:14,125 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:10:14,126 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:10:14,127 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:10:14,127 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:10:14,128 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:10:14,129 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:10:14,129 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:10:14,130 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:10:14,131 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:10:14,135 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:14,136 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:14,136 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:14,137 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:14,137 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:14,138 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:14,138 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:15,130 WARN [Listener at jenkins-hbase4.apache.org/37521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:10:15,136 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-21 05:10:15,144 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 05:10:15,716 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:15,718 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:15,801 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:10:16,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:21,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:24,080 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:27,263 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:29,166 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:10:29,169 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:10:29,178 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-21 05:10:29,178 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:10:29,179 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:10:29,179 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 05:10:29,179 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-21 05:10:29,180 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-21 05:10:29,180 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839/.hbase-snapshot/testExportWithTargetName 2023-07-21 05:10:29,180 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-21 05:10:29,180 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916212839/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-21 05:10:29,191 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-21 05:10:29,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-21 05:10:29,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 05:10:29,223 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916229223"}]},"ts":"1689916229223"} 2023-07-21 05:10:29,226 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-21 05:10:29,229 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-21 05:10:29,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=18438ba5b441f68c5138432b0c85bf73, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd2d7e75feeacff9e4ddafc6ae6aca38, UNASSIGN}] 2023-07-21 05:10:29,234 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=18438ba5b441f68c5138432b0c85bf73, UNASSIGN 2023-07-21 05:10:29,236 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=18438ba5b441f68c5138432b0c85bf73, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:29,236 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd2d7e75feeacff9e4ddafc6ae6aca38, UNASSIGN 2023-07-21 05:10:29,236 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916229236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916229236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916229236"}]},"ts":"1689916229236"} 2023-07-21 05:10:29,239 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dd2d7e75feeacff9e4ddafc6ae6aca38, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:29,240 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916229239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916229239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916229239"}]},"ts":"1689916229239"} 2023-07-21 05:10:29,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 18438ba5b441f68c5138432b0c85bf73, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:10:29,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure dd2d7e75feeacff9e4ddafc6ae6aca38, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:10:29,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 05:10:29,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:29,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:29,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd2d7e75feeacff9e4ddafc6ae6aca38, disabling compactions & flushes 2023-07-21 05:10:29,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18438ba5b441f68c5138432b0c85bf73, disabling compactions & flushes 2023-07-21 05:10:29,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:29,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:29,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:29,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:29,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. after waiting 0 ms 2023-07-21 05:10:29,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. after waiting 0 ms 2023-07-21 05:10:29,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:29,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:29,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:10:29,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:10:29,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:29,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:29,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73. 2023-07-21 05:10:29,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18438ba5b441f68c5138432b0c85bf73: 2023-07-21 05:10:29,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38. 2023-07-21 05:10:29,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd2d7e75feeacff9e4ddafc6ae6aca38: 2023-07-21 05:10:29,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:29,434 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=18438ba5b441f68c5138432b0c85bf73, regionState=CLOSED 2023-07-21 05:10:29,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:29,434 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916229434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916229434"}]},"ts":"1689916229434"} 2023-07-21 05:10:29,435 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dd2d7e75feeacff9e4ddafc6ae6aca38, regionState=CLOSED 2023-07-21 05:10:29,435 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916229435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916229435"}]},"ts":"1689916229435"} 2023-07-21 05:10:29,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-21 05:10:29,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 18438ba5b441f68c5138432b0c85bf73, server=jenkins-hbase4.apache.org,39445,1689916199184 in 197 msec 2023-07-21 05:10:29,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-21 05:10:29,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure dd2d7e75feeacff9e4ddafc6ae6aca38, server=jenkins-hbase4.apache.org,36249,1689916199318 in 198 msec 2023-07-21 05:10:29,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=18438ba5b441f68c5138432b0c85bf73, UNASSIGN in 213 msec 2023-07-21 05:10:29,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-21 05:10:29,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd2d7e75feeacff9e4ddafc6ae6aca38, UNASSIGN in 214 msec 2023-07-21 05:10:29,454 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916229454"}]},"ts":"1689916229454"} 2023-07-21 05:10:29,459 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-21 05:10:29,461 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-21 05:10:29,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 262 msec 2023-07-21 05:10:29,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 05:10:29,521 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-21 05:10:29,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-21 05:10:29,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,536 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-21 05:10:29,538 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,541 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-21 05:10:29,544 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:29,544 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:29,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 05:10:29,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 05:10:29,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 05:10:29,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 05:10:29,546 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,546 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,546 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,546 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,546 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,546 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,548 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,548 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,548 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/recovered.edits] 2023-07-21 05:10:29,548 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/recovered.edits] 2023-07-21 05:10:29,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 05:10:29,557 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf/020cdc93ad554e4792d268a29056ff0e to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/cf/020cdc93ad554e4792d268a29056ff0e 2023-07-21 05:10:29,557 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf/db4aa9a7fda340e2858d54fe01d2ff38 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/cf/db4aa9a7fda340e2858d54fe01d2ff38 2023-07-21 05:10:29,562 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73/recovered.edits/9.seqid 2023-07-21 05:10:29,562 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38/recovered.edits/9.seqid 2023-07-21 05:10:29,562 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/18438ba5b441f68c5138432b0c85bf73 2023-07-21 05:10:29,563 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportWithTargetName/dd2d7e75feeacff9e4ddafc6ae6aca38 2023-07-21 05:10:29,563 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 05:10:29,566 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,588 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-21 05:10:29,591 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-21 05:10:29,593 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,593 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-21 05:10:29,594 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916229593"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:29,594 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916229593"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:29,599 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:10:29,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 18438ba5b441f68c5138432b0c85bf73, NAME => 'testtb-testExportWithTargetName,,1689916209769.18438ba5b441f68c5138432b0c85bf73.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dd2d7e75feeacff9e4ddafc6ae6aca38, NAME => 'testtb-testExportWithTargetName,1,1689916209769.dd2d7e75feeacff9e4ddafc6ae6aca38.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:10:29,600 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-21 05:10:29,600 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916229600"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:29,602 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-21 05:10:29,604 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-07-21 05:10:29,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 05:10:29,652 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-21 05:10:29,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-21 05:10:29,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:29,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-21 05:10:29,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-21 05:10:29,709 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 710) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:46479 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-56903820_1 at /127.0.0.1:47710 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:47734 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:38163 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:60672 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1394554192_17 at /127.0.0.1:55688 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 382), ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=2748 (was 4416) 2023-07-21 05:10:29,710 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-21 05:10:29,731 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=183, AvailableMemoryMB=2748 2023-07-21 05:10:29,731 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-21 05:10:29,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:29,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:29,738 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:29,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-21 05:10:29,740 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:29,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 05:10:29,744 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:29,744 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:29,745 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb empty. 2023-07-21 05:10:29,745 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114 empty. 2023-07-21 05:10:29,745 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:29,745 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:29,745 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 05:10:29,763 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:29,764 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => dc0c31b1ff7498b283f457e92570e114, NAME => 'testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:10:29,764 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => a0ed7db0a581aec362d63df185f40fcb, NAME => 'testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:10:29,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:29,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing dc0c31b1ff7498b283f457e92570e114, disabling compactions & flushes 2023-07-21 05:10:29,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:29,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:29,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. after waiting 0 ms 2023-07-21 05:10:29,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:29,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:29,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for dc0c31b1ff7498b283f457e92570e114: 2023-07-21 05:10:29,786 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:29,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing a0ed7db0a581aec362d63df185f40fcb, disabling compactions & flushes 2023-07-21 05:10:29,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:29,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:29,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. after waiting 0 ms 2023-07-21 05:10:29,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:29,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:29,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for a0ed7db0a581aec362d63df185f40fcb: 2023-07-21 05:10:29,791 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:29,792 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916229792"}]},"ts":"1689916229792"} 2023-07-21 05:10:29,792 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916229792"}]},"ts":"1689916229792"} 2023-07-21 05:10:29,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:10:29,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:29,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916229797"}]},"ts":"1689916229797"} 2023-07-21 05:10:29,799 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 05:10:29,804 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:29,805 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:29,805 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:29,805 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:29,805 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:29,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ed7db0a581aec362d63df185f40fcb, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc0c31b1ff7498b283f457e92570e114, ASSIGN}] 2023-07-21 05:10:29,809 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc0c31b1ff7498b283f457e92570e114, ASSIGN 2023-07-21 05:10:29,809 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ed7db0a581aec362d63df185f40fcb, ASSIGN 2023-07-21 05:10:29,810 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc0c31b1ff7498b283f457e92570e114, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36249,1689916199318; forceNewPlan=false, retain=false 2023-07-21 05:10:29,810 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ed7db0a581aec362d63df185f40fcb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39445,1689916199184; forceNewPlan=false, retain=false 2023-07-21 05:10:29,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 05:10:29,961 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:10:29,964 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a0ed7db0a581aec362d63df185f40fcb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:29,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=dc0c31b1ff7498b283f457e92570e114, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:29,964 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916229964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916229964"}]},"ts":"1689916229964"} 2023-07-21 05:10:29,964 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916229964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916229964"}]},"ts":"1689916229964"} 2023-07-21 05:10:29,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure dc0c31b1ff7498b283f457e92570e114, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:10:29,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure a0ed7db0a581aec362d63df185f40fcb, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:10:30,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 05:10:30,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:30,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0ed7db0a581aec362d63df185f40fcb, NAME => 'testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:10:30,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. service=AccessControlService 2023-07-21 05:10:30,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:30,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc0c31b1ff7498b283f457e92570e114, NAME => 'testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:10:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:30,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. service=AccessControlService 2023-07-21 05:10:30,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:30,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:30,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:30,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:30,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:30,129 INFO [StoreOpener-a0ed7db0a581aec362d63df185f40fcb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:30,129 INFO [StoreOpener-dc0c31b1ff7498b283f457e92570e114-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:30,130 DEBUG [StoreOpener-a0ed7db0a581aec362d63df185f40fcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf 2023-07-21 05:10:30,130 DEBUG [StoreOpener-a0ed7db0a581aec362d63df185f40fcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf 2023-07-21 05:10:30,131 INFO [StoreOpener-a0ed7db0a581aec362d63df185f40fcb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0ed7db0a581aec362d63df185f40fcb columnFamilyName cf 2023-07-21 05:10:30,131 DEBUG [StoreOpener-dc0c31b1ff7498b283f457e92570e114-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf 2023-07-21 05:10:30,131 DEBUG [StoreOpener-dc0c31b1ff7498b283f457e92570e114-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf 2023-07-21 05:10:30,131 INFO [StoreOpener-dc0c31b1ff7498b283f457e92570e114-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc0c31b1ff7498b283f457e92570e114 columnFamilyName cf 2023-07-21 05:10:30,131 INFO [StoreOpener-a0ed7db0a581aec362d63df185f40fcb-1] regionserver.HStore(310): Store=a0ed7db0a581aec362d63df185f40fcb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:30,133 INFO [StoreOpener-dc0c31b1ff7498b283f457e92570e114-1] regionserver.HStore(310): Store=dc0c31b1ff7498b283f457e92570e114/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:30,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:30,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:30,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:30,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:30,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:30,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:30,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:30,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:30,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a0ed7db0a581aec362d63df185f40fcb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62663444, jitterRate=-0.06624191999435425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:30,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a0ed7db0a581aec362d63df185f40fcb: 2023-07-21 05:10:30,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc0c31b1ff7498b283f457e92570e114; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73495830, jitterRate=0.09517320990562439}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:30,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc0c31b1ff7498b283f457e92570e114: 2023-07-21 05:10:30,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114., pid=30, masterSystemTime=1689916230121 2023-07-21 05:10:30,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb., pid=31, masterSystemTime=1689916230122 2023-07-21 05:10:30,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:30,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:30,150 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=dc0c31b1ff7498b283f457e92570e114, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:30,150 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916230150"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916230150"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916230150"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916230150"}]},"ts":"1689916230150"} 2023-07-21 05:10:30,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:30,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:30,153 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a0ed7db0a581aec362d63df185f40fcb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:30,154 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916230153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916230153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916230153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916230153"}]},"ts":"1689916230153"} 2023-07-21 05:10:30,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-21 05:10:30,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure dc0c31b1ff7498b283f457e92570e114, server=jenkins-hbase4.apache.org,36249,1689916199318 in 187 msec 2023-07-21 05:10:30,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-21 05:10:30,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure a0ed7db0a581aec362d63df185f40fcb, server=jenkins-hbase4.apache.org,39445,1689916199184 in 189 msec 2023-07-21 05:10:30,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc0c31b1ff7498b283f457e92570e114, ASSIGN in 353 msec 2023-07-21 05:10:30,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-21 05:10:30,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ed7db0a581aec362d63df185f40fcb, ASSIGN in 358 msec 2023-07-21 05:10:30,168 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:30,169 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916230169"}]},"ts":"1689916230169"} 2023-07-21 05:10:30,170 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 05:10:30,173 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:30,174 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-21 05:10:30,176 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:10:30,178 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:30,178 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:30,178 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:30,178 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:30,181 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:30,181 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:30,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:30,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:30,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:30,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:30,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 448 msec 2023-07-21 05:10:30,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 05:10:30,347 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-21 05:10:30,347 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-21 05:10:30,347 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:30,351 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-21 05:10:30,351 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:30,351 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-21 05:10:30,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:30,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916230354 (current time:1689916230354). 2023-07-21 05:10:30,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:30,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x2b85ada5 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:30,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66655e62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:30,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:30,420 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:30,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b85ada5 to 127.0.0.1:53187 2023-07-21 05:10:30,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:30,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x18b16e0f to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:30,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e5f0039, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:30,542 DEBUG [hconnection-0x5205dbde-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:30,545 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:30,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:30,552 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:30,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18b16e0f to 127.0.0.1:53187 2023-07-21 05:10:30,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:30,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:10:30,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:30,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:30,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:30,558 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:30,559 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689916830559 2023-07-21 05:10:30,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:30,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 05:10:30,560 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:30,561 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:30,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:30,562 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:30,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-21 05:10:30,566 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:30,567 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689916830567 2023-07-21 05:10:30,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,587 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-21 05:10:30,587 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:30,588 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 05:10:30,588 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 05:10:30,656 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,656 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,661 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:30,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:30,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:30,662 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:30,708 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,708 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:30,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,708 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,708 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,709 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,709 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,709 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:30,709 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,710 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:30,710 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:30,710 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:30,710 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:30,710 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:30,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,713 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:30,713 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:30,713 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:30,713 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:30,713 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:30,714 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:30,714 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:30,714 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:30,770 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:30,770 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:30,862 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:30,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:30,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:30,863 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:30,993 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,054 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,055 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:31,055 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:31,055 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,055 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:31,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 05:10:31,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dd69ba3[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:31,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 05:10:31,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dd69ba3[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:31,059 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 05:10:31,059 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,139 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,139 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,139 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,140 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:31,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:10:31,140 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:31,140 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. started... 2023-07-21 05:10:31,140 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,141 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:31,140 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:31,142 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. started... 2023-07-21 05:10:31,142 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc0c31b1ff7498b283f457e92570e114: 2023-07-21 05:10:31,144 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0ed7db0a581aec362d63df185f40fcb: 2023-07-21 05:10:31,144 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,144 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,144 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:31,144 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:31,144 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:31,144 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:31,164 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:31,165 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. completed. 2023-07-21 05:10:31,165 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:31,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:31,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:10:31,165 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 05:10:31,166 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. completed. 2023-07-21 05:10:31,166 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:31,166 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:31,166 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:31,166 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,166 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:31,166 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:10:31,193 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:31,193 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:31,193 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:31,224 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:31,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:31,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:31,225 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,225 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39445,1689916199184': 2023-07-21 05:10:31,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 05:10:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:10:31,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 05:10:31,236 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-21 05:10:31,236 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:31,236 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:31,236 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,236 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:31,316 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:31,316 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:31,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,316 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:31,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:31,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:31,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:31,317 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,318 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:31,318 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,320 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,321 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,321 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,377 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:31,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:31,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:31,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:31,378 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,378 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:31,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:31,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:31,378 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:31,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:31,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:31,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,381 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:31,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:31,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:31,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 05:10:31,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,435 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:31,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689916230559Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689916231378 (+819 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689916231378Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689916231388 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689916231405 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689916231434 (+29 ms) 2023-07-21 05:10:31,438 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:31,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 878 msec 2023-07-21 05:10:31,667 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:31,668 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-21 05:10:31,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:31,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:31,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39445] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:31,683 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36249] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:31,687 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 05:10:31,687 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:31,688 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:31,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:31,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916231702 (current time:1689916231702). 2023-07-21 05:10:31,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:31,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x6d53695e to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:31,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f1fda13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:31,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:31,786 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:31,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d53695e to 127.0.0.1:53187 2023-07-21 05:10:31,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:31,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x5d45782b to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:31,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ae46b60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:31,903 DEBUG [hconnection-0x5e308f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:31,904 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:31,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:31,910 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:31,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d45782b to 127.0.0.1:53187 2023-07-21 05:10:31,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:31,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:10:31,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:31,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:31,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:31,997 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:31,998 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689916831998 2023-07-21 05:10:31,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:31,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 05:10:31,999 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:32,000 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:32,001 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:32,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:32,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-21 05:10:32,003 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:32,004 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689916832004 2023-07-21 05:10:32,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-21 05:10:32,018 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-21 05:10:32,018 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:32,019 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 05:10:32,019 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 05:10:32,047 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,047 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,100 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:32,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:32,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:32,101 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:32,124 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,124 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,124 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,124 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,124 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,124 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,125 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,125 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,125 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:32,126 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 05:10:32,126 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 05:10:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 05:10:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,126 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,127 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:32,127 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:32,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:32,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:32,127 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:32,128 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 05:10:32,128 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 05:10:32,128 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:32,128 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:32,128 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:32,128 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:32,130 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:32,131 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:32,131 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:32,131 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:32,131 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:32,131 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:32,193 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,193 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,278 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:32,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:32,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:32,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:32,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 05:10:32,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18882b73[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:32,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:32,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:32,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:32,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:32,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:32,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 05:10:32,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18882b73[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:32,283 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 05:10:32,283 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,301 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:32,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:32,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:32,302 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:32,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,331 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,332 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:32,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,332 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,332 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:32,332 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:32,332 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:32,332 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. started... 2023-07-21 05:10:32,332 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:32,332 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:32,332 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:32,332 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a0ed7db0a581aec362d63df185f40fcb 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-21 05:10:32,332 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,332 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:32,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,332 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. started... 2023-07-21 05:10:32,332 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:32,332 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:32,333 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:32,333 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:10:32,333 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dc0c31b1ff7498b283f457e92570e114 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-21 05:10:32,354 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/.tmp/cf/21d627b5d52e4b94861138aff5a47c3f 2023-07-21 05:10:32,354 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/.tmp/cf/747bb5c495864f28990763505e72b399 2023-07-21 05:10:32,364 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/.tmp/cf/747bb5c495864f28990763505e72b399 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf/747bb5c495864f28990763505e72b399 2023-07-21 05:10:32,364 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/.tmp/cf/21d627b5d52e4b94861138aff5a47c3f as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf/21d627b5d52e4b94861138aff5a47c3f 2023-07-21 05:10:32,371 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf/747bb5c495864f28990763505e72b399, entries=45, sequenceid=6, filesize=7.9 K 2023-07-21 05:10:32,372 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf/21d627b5d52e4b94861138aff5a47c3f, entries=5, sequenceid=6, filesize=5.2 K 2023-07-21 05:10:32,374 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for dc0c31b1ff7498b283f457e92570e114 in 41ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:32,374 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a0ed7db0a581aec362d63df185f40fcb in 42ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:32,378 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0ed7db0a581aec362d63df185f40fcb: 2023-07-21 05:10:32,378 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc0c31b1ff7498b283f457e92570e114: 2023-07-21 05:10:32,379 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:32,379 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:32,379 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:32,379 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf/21d627b5d52e4b94861138aff5a47c3f] hfiles 2023-07-21 05:10:32,379 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:32,379 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf/21d627b5d52e4b94861138aff5a47c3f for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:32,379 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf/747bb5c495864f28990763505e72b399] hfiles 2023-07-21 05:10:32,379 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf/747bb5c495864f28990763505e72b399 for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:32,399 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. completed. 2023-07-21 05:10:32,399 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:10:32,401 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. completed. 2023-07-21 05:10:32,401 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:10:32,408 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:32,408 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:32,408 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:32,602 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:32,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:32,604 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 05:10:32,608 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,608 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:32,608 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:32,608 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,608 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:32,609 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:32,610 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:32,610 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:10:32,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 05:10:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39445,1689916199184': 2023-07-21 05:10:32,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 05:10:32,619 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-21 05:10:32,619 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:32,619 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:32,619 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-21 05:10:32,619 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:32,670 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,670 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,670 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,671 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:32,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,672 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:32,675 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:32,677 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,677 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,678 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,731 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-21 05:10:32,732 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:32,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-21 05:10:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,732 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,735 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,735 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,735 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,735 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,735 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:32,735 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:32,735 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,735 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 05:10:32,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,779 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689916231998Consolidate snapshot: snaptb0-testExportFileSystemState at 1689916232732 (+734 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689916232735 (+3 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689916232739 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689916232748 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689916232779 (+31 ms) 2023-07-21 05:10:32,782 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:32,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 783 msec 2023-07-21 05:10:33,104 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:33,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:33,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:33,107 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107 2023-07-21 05:10:33,107 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36811, tgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107, rawTgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107, srcFsUri=hdfs://localhost:36811, srcDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:33,139 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:33,139 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1670223148_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:33,139 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab, snapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-21 05:10:33,149 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:33,179 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,179 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,180 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,180 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:34,236 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-8732334640813145142.jar 2023-07-21 05:10:34,237 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:34,237 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:34,310 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-3003533311122646829.jar 2023-07-21 05:10:34,310 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:34,311 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:34,311 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:34,312 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:34,312 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:34,312 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:34,313 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:10:34,313 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:10:34,314 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:10:34,314 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:10:34,315 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:10:34,315 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:10:34,316 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:10:34,316 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:10:34,316 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:10:34,317 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:10:34,317 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:34,318 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:34,318 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:34,319 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:34,319 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:34,319 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:34,320 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:35,017 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:10:35,319 WARN [Listener at jenkins-hbase4.apache.org/37521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:10:35,322 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-21 05:10:35,325 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 05:10:35,815 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:35,815 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:36,480 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:40,954 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:43,185 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:45,821 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:46,930 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:10:46,933 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:10:46,941 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-21 05:10:46,942 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:10:46,942 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:10:46,942 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 05:10:46,943 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 05:10:46,943 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 05:10:46,943 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 05:10:46,943 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 05:10:46,943 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916233107/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 05:10:46,950 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-21 05:10:46,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-21 05:10:46,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:46,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 05:10:46,957 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916246957"}]},"ts":"1689916246957"} 2023-07-21 05:10:46,959 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 05:10:46,961 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-21 05:10:46,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ed7db0a581aec362d63df185f40fcb, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc0c31b1ff7498b283f457e92570e114, UNASSIGN}] 2023-07-21 05:10:46,964 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ed7db0a581aec362d63df185f40fcb, UNASSIGN 2023-07-21 05:10:46,964 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc0c31b1ff7498b283f457e92570e114, UNASSIGN 2023-07-21 05:10:46,965 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a0ed7db0a581aec362d63df185f40fcb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:46,965 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916246965"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916246965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916246965"}]},"ts":"1689916246965"} 2023-07-21 05:10:46,966 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=dc0c31b1ff7498b283f457e92570e114, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:46,966 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916246965"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916246965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916246965"}]},"ts":"1689916246965"} 2023-07-21 05:10:46,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure a0ed7db0a581aec362d63df185f40fcb, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:10:46,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure dc0c31b1ff7498b283f457e92570e114, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:10:47,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 05:10:47,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:47,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a0ed7db0a581aec362d63df185f40fcb, disabling compactions & flushes 2023-07-21 05:10:47,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:47,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:47,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. after waiting 0 ms 2023-07-21 05:10:47,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:47,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:47,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc0c31b1ff7498b283f457e92570e114, disabling compactions & flushes 2023-07-21 05:10:47,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:47,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. after waiting 0 ms 2023-07-21 05:10:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:47,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:10:47,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:10:47,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:47,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb. 2023-07-21 05:10:47,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a0ed7db0a581aec362d63df185f40fcb: 2023-07-21 05:10:47,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:47,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114. 2023-07-21 05:10:47,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc0c31b1ff7498b283f457e92570e114: 2023-07-21 05:10:47,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:47,138 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a0ed7db0a581aec362d63df185f40fcb, regionState=CLOSED 2023-07-21 05:10:47,138 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916247138"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916247138"}]},"ts":"1689916247138"} 2023-07-21 05:10:47,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:47,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=dc0c31b1ff7498b283f457e92570e114, regionState=CLOSED 2023-07-21 05:10:47,139 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916247139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916247139"}]},"ts":"1689916247139"} 2023-07-21 05:10:47,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-21 05:10:47,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure a0ed7db0a581aec362d63df185f40fcb, server=jenkins-hbase4.apache.org,39445,1689916199184 in 173 msec 2023-07-21 05:10:47,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-21 05:10:47,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure dc0c31b1ff7498b283f457e92570e114, server=jenkins-hbase4.apache.org,36249,1689916199318 in 173 msec 2023-07-21 05:10:47,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ed7db0a581aec362d63df185f40fcb, UNASSIGN in 180 msec 2023-07-21 05:10:47,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-21 05:10:47,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dc0c31b1ff7498b283f457e92570e114, UNASSIGN in 181 msec 2023-07-21 05:10:47,146 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916247146"}]},"ts":"1689916247146"} 2023-07-21 05:10:47,147 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 05:10:47,148 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-21 05:10:47,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-07-21 05:10:47,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 05:10:47,260 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-21 05:10:47,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-21 05:10:47,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:47,266 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:47,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-21 05:10:47,267 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:47,269 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-21 05:10:47,273 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:47,273 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:47,273 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:47,273 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:47,273 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:47,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 05:10:47,273 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:47,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 05:10:47,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 05:10:47,275 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:47,275 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:47,275 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,275 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:47,275 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-21 05:10:47,275 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,275 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,276 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:10:47,276 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/recovered.edits] 2023-07-21 05:10:47,276 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/recovered.edits] 2023-07-21 05:10:47,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 05:10:47,284 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf/21d627b5d52e4b94861138aff5a47c3f to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/cf/21d627b5d52e4b94861138aff5a47c3f 2023-07-21 05:10:47,284 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf/747bb5c495864f28990763505e72b399 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/cf/747bb5c495864f28990763505e72b399 2023-07-21 05:10:47,289 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb/recovered.edits/9.seqid 2023-07-21 05:10:47,290 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/a0ed7db0a581aec362d63df185f40fcb 2023-07-21 05:10:47,290 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114/recovered.edits/9.seqid 2023-07-21 05:10:47,291 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemState/dc0c31b1ff7498b283f457e92570e114 2023-07-21 05:10:47,291 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 05:10:47,294 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:47,297 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-21 05:10:47,300 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-21 05:10:47,303 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:47,303 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-21 05:10:47,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916247303"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:47,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916247303"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:47,311 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:10:47,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a0ed7db0a581aec362d63df185f40fcb, NAME => 'testtb-testExportFileSystemState,,1689916229733.a0ed7db0a581aec362d63df185f40fcb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dc0c31b1ff7498b283f457e92570e114, NAME => 'testtb-testExportFileSystemState,1,1689916229733.dc0c31b1ff7498b283f457e92570e114.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:10:47,311 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-21 05:10:47,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916247311"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:47,313 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-21 05:10:47,315 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:47,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 54 msec 2023-07-21 05:10:47,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 05:10:47,379 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-21 05:10:47,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-21 05:10:47,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:47,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-21 05:10:47,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-21 05:10:47,417 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=761 (was 755) Potentially hanging thread: Thread-1937 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:45122 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-794983252_1 at /127.0.0.1:56098 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-794983252_1 at /127.0.0.1:45100 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:43235 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:38739 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:56118 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:38878 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=455 (was 376) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2512 (was 2748) 2023-07-21 05:10:47,418 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-21 05:10:47,437 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=455, ProcessCount=183, AvailableMemoryMB=2511 2023-07-21 05:10:47,437 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-21 05:10:47,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:47,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:10:47,444 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:47,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-21 05:10:47,446 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:47,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 05:10:47,449 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,449 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,450 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626 empty. 2023-07-21 05:10:47,450 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa empty. 2023-07-21 05:10:47,451 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,452 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,453 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 05:10:47,495 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:47,497 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7edf2af77112494fb4d9005d0616c626, NAME => 'testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:10:47,497 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8d026947b378b421654c91f05be664aa, NAME => 'testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:10:47,533 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:47,533 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7edf2af77112494fb4d9005d0616c626, disabling compactions & flushes 2023-07-21 05:10:47,533 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:47,533 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:47,533 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. after waiting 0 ms 2023-07-21 05:10:47,533 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:47,533 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:47,533 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7edf2af77112494fb4d9005d0616c626: 2023-07-21 05:10:47,538 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:47,538 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8d026947b378b421654c91f05be664aa, disabling compactions & flushes 2023-07-21 05:10:47,538 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:47,538 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:47,538 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. after waiting 0 ms 2023-07-21 05:10:47,538 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:47,538 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:47,538 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8d026947b378b421654c91f05be664aa: 2023-07-21 05:10:47,541 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:47,542 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916247542"}]},"ts":"1689916247542"} 2023-07-21 05:10:47,542 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916247542"}]},"ts":"1689916247542"} 2023-07-21 05:10:47,545 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:10:47,546 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:47,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916247546"}]},"ts":"1689916247546"} 2023-07-21 05:10:47,548 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-21 05:10:47,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 05:10:47,553 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:47,554 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:47,554 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:47,554 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:47,554 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:47,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7edf2af77112494fb4d9005d0616c626, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d026947b378b421654c91f05be664aa, ASSIGN}] 2023-07-21 05:10:47,558 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d026947b378b421654c91f05be664aa, ASSIGN 2023-07-21 05:10:47,559 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7edf2af77112494fb4d9005d0616c626, ASSIGN 2023-07-21 05:10:47,560 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d026947b378b421654c91f05be664aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39445,1689916199184; forceNewPlan=false, retain=false 2023-07-21 05:10:47,560 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7edf2af77112494fb4d9005d0616c626, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36249,1689916199318; forceNewPlan=false, retain=false 2023-07-21 05:10:47,710 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:10:47,713 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8d026947b378b421654c91f05be664aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:47,713 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7edf2af77112494fb4d9005d0616c626, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:47,713 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247713"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916247713"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916247713"}]},"ts":"1689916247713"} 2023-07-21 05:10:47,713 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247713"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916247713"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916247713"}]},"ts":"1689916247713"} 2023-07-21 05:10:47,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 7edf2af77112494fb4d9005d0616c626, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:10:47,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 8d026947b378b421654c91f05be664aa, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:10:47,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 05:10:47,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:47,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7edf2af77112494fb4d9005d0616c626, NAME => 'testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:10:47,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. service=AccessControlService 2023-07-21 05:10:47,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:47,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:47,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d026947b378b421654c91f05be664aa, NAME => 'testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:10:47,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:47,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. service=AccessControlService 2023-07-21 05:10:47,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:47,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:47,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,874 INFO [StoreOpener-7edf2af77112494fb4d9005d0616c626-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,875 INFO [StoreOpener-8d026947b378b421654c91f05be664aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,877 DEBUG [StoreOpener-8d026947b378b421654c91f05be664aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf 2023-07-21 05:10:47,877 DEBUG [StoreOpener-8d026947b378b421654c91f05be664aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf 2023-07-21 05:10:47,877 INFO [StoreOpener-8d026947b378b421654c91f05be664aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d026947b378b421654c91f05be664aa columnFamilyName cf 2023-07-21 05:10:47,878 DEBUG [StoreOpener-7edf2af77112494fb4d9005d0616c626-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf 2023-07-21 05:10:47,878 DEBUG [StoreOpener-7edf2af77112494fb4d9005d0616c626-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf 2023-07-21 05:10:47,878 INFO [StoreOpener-7edf2af77112494fb4d9005d0616c626-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7edf2af77112494fb4d9005d0616c626 columnFamilyName cf 2023-07-21 05:10:47,878 INFO [StoreOpener-8d026947b378b421654c91f05be664aa-1] regionserver.HStore(310): Store=8d026947b378b421654c91f05be664aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:47,879 INFO [StoreOpener-7edf2af77112494fb4d9005d0616c626-1] regionserver.HStore(310): Store=7edf2af77112494fb4d9005d0616c626/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:47,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8d026947b378b421654c91f05be664aa 2023-07-21 05:10:47,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7edf2af77112494fb4d9005d0616c626 2023-07-21 05:10:47,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:47,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:47,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8d026947b378b421654c91f05be664aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62719939, jitterRate=-0.06540007889270782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:47,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8d026947b378b421654c91f05be664aa: 2023-07-21 05:10:47,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7edf2af77112494fb4d9005d0616c626; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74389528, jitterRate=0.10849034786224365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:47,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7edf2af77112494fb4d9005d0616c626: 2023-07-21 05:10:47,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa., pid=46, masterSystemTime=1689916247868 2023-07-21 05:10:47,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626., pid=45, masterSystemTime=1689916247867 2023-07-21 05:10:47,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:47,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:47,892 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8d026947b378b421654c91f05be664aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:47,892 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247892"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916247892"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916247892"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916247892"}]},"ts":"1689916247892"} 2023-07-21 05:10:47,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:47,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:47,894 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7edf2af77112494fb4d9005d0616c626, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:47,894 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247894"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916247894"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916247894"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916247894"}]},"ts":"1689916247894"} 2023-07-21 05:10:47,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-21 05:10:47,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 8d026947b378b421654c91f05be664aa, server=jenkins-hbase4.apache.org,39445,1689916199184 in 178 msec 2023-07-21 05:10:47,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-21 05:10:47,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 7edf2af77112494fb4d9005d0616c626, server=jenkins-hbase4.apache.org,36249,1689916199318 in 181 msec 2023-07-21 05:10:47,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d026947b378b421654c91f05be664aa, ASSIGN in 343 msec 2023-07-21 05:10:47,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-21 05:10:47,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7edf2af77112494fb4d9005d0616c626, ASSIGN in 344 msec 2023-07-21 05:10:47,905 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:47,905 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916247905"}]},"ts":"1689916247905"} 2023-07-21 05:10:47,908 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-21 05:10:47,910 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:47,910 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-21 05:10:47,913 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 05:10:47,914 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,915 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,915 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,915 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:47,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:47,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:47,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:47,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 476 msec 2023-07-21 05:10:48,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 05:10:48,051 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-21 05:10:48,052 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-21 05:10:48,052 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:48,062 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-21 05:10:48,062 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:48,063 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-21 05:10:48,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:48,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916248074 (current time:1689916248074). 2023-07-21 05:10:48,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:48,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x7a6cb857 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:48,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bd40fcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:48,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:48,094 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:48,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a6cb857 to 127.0.0.1:53187 2023-07-21 05:10:48,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:48,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x21066cc8 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:48,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3eb7d6bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:48,119 DEBUG [hconnection-0x557604ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:48,122 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:48,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:48,131 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:48,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21066cc8 to 127.0.0.1:53187 2023-07-21 05:10:48,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:48,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 05:10:48,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:48,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:48,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:48,138 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:48,143 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689916848143 2023-07-21 05:10:48,143 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 05:10:48,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:48,145 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:48,145 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:48,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:48,146 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:48,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 11 msec 2023-07-21 05:10:48,149 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:48,149 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689916848149 2023-07-21 05:10:48,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,182 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-21 05:10:48,183 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,184 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 05:10:48,184 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 05:10:48,185 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,185 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,186 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,186 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,186 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,186 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,187 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,187 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,187 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,187 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 05:10:48,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,188 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 05:10:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 05:10:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:48,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:48,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,191 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:48,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,191 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,191 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:48,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,193 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,193 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:48,194 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,194 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,194 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,194 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,198 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,198 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,198 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,199 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,199 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,199 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,202 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,202 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,202 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,202 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,202 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,202 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,202 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,202 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 05:10:48,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4b5711[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:48,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 05:10:48,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4b5711[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:48,208 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 05:10:48,208 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,209 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,209 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,209 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,210 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,210 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,210 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,210 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:48,210 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,210 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:48,210 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:48,210 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,210 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:10:48,210 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. started... 2023-07-21 05:10:48,210 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,211 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:48,212 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:48,213 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:48,213 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7edf2af77112494fb4d9005d0616c626: 2023-07-21 05:10:48,213 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:48,213 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. started... 2023-07-21 05:10:48,213 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,215 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:48,215 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:48,215 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,215 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,215 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,216 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d026947b378b421654c91f05be664aa: 2023-07-21 05:10:48,216 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,216 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:48,216 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:48,240 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. completed. 2023-07-21 05:10:48,241 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:48,241 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:48,241 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:48,241 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,241 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,241 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:10:48,242 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. completed. 2023-07-21 05:10:48,242 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:48,242 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:48,242 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:48,242 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,242 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,242 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:10:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,243 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,244 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,245 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,244 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,246 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:48,245 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:48,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,247 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39445,1689916199184': 2023-07-21 05:10:48,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 05:10:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:10:48,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 05:10:48,254 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-21 05:10:48,254 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:48,254 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:48,254 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,254 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:48,257 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,257 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,257 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,258 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,259 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,259 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,261 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,262 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,262 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,265 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,265 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,265 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,265 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,265 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,265 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,265 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,265 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,265 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,267 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,268 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,265 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,268 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,267 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,268 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,268 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,268 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,268 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,268 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,316 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 05:10:48,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,317 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:48,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689916248143Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689916248265 (+122 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689916248266 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689916248275 (+9 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689916248283 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689916248316 (+33 ms) 2023-07-21 05:10:48,323 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:48,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 179 msec 2023-07-21 05:10:48,447 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:48,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:48,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:48,456 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36249] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:48,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39445] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:48,462 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 05:10:48,462 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:48,464 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:48,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:48,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916248479 (current time:1689916248479). 2023-07-21 05:10:48,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:48,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x275fb691 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:48,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b568a78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:48,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:48,497 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:48,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x275fb691 to 127.0.0.1:53187 2023-07-21 05:10:48,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:48,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x664403c0 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:48,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c75daa7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:48,507 DEBUG [hconnection-0x236f821b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:48,510 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:48,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:48,516 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:48,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x664403c0 to 127.0.0.1:53187 2023-07-21 05:10:48,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:48,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 05:10:48,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:48,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:48,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:48,521 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:48,522 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689916848522 2023-07-21 05:10:48,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:48,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 05:10:48,523 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:48,523 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:48,524 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:48,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:48,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-21 05:10:48,526 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:48,527 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689916848527 2023-07-21 05:10:48,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-21 05:10:48,539 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-21 05:10:48,539 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,540 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 05:10:48,540 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 05:10:48,541 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,541 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,542 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,542 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,542 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,542 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,543 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,544 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,550 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,551 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 05:10:48,551 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 05:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,551 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:48,551 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:48,553 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,553 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,553 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,553 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 05:10:48,555 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,555 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:48,555 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,555 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,555 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,556 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,556 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,557 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,559 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,561 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,561 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,561 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,561 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,563 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,563 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,563 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,563 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,563 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,564 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 05:10:48,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@536e2117[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 05:10:48,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@536e2117[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:48,568 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 05:10:48,568 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,571 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,571 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,571 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,571 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:10:48,571 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:48,571 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:48,571 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:48,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,572 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. started... 2023-07-21 05:10:48,572 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,571 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,572 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:48,572 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:48,572 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:48,572 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8d026947b378b421654c91f05be664aa 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-21 05:10:48,572 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:48,572 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. started... 2023-07-21 05:10:48,572 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7edf2af77112494fb4d9005d0616c626 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-21 05:10:48,573 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,573 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,573 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,596 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/.tmp/cf/3e6c88ea1a2d41dc9c084a0756215555 2023-07-21 05:10:48,608 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/.tmp/cf/3e6c88ea1a2d41dc9c084a0756215555 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf/3e6c88ea1a2d41dc9c084a0756215555 2023-07-21 05:10:48,614 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/.tmp/cf/69f134dfefc04bbca1f5ced5a7dd5dc0 2023-07-21 05:10:48,615 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf/3e6c88ea1a2d41dc9c084a0756215555, entries=1, sequenceid=6, filesize=4.9 K 2023-07-21 05:10:48,616 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 7edf2af77112494fb4d9005d0616c626 in 44ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:48,616 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-21 05:10:48,617 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7edf2af77112494fb4d9005d0616c626: 2023-07-21 05:10:48,617 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,617 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:48,617 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf/3e6c88ea1a2d41dc9c084a0756215555] hfiles 2023-07-21 05:10:48,617 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf/3e6c88ea1a2d41dc9c084a0756215555 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,621 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/.tmp/cf/69f134dfefc04bbca1f5ced5a7dd5dc0 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf/69f134dfefc04bbca1f5ced5a7dd5dc0 2023-07-21 05:10:48,623 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:48,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:48,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:48,625 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:48,627 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf/69f134dfefc04bbca1f5ced5a7dd5dc0, entries=49, sequenceid=6, filesize=8.1 K 2023-07-21 05:10:48,629 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 8d026947b378b421654c91f05be664aa in 57ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:48,634 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d026947b378b421654c91f05be664aa: 2023-07-21 05:10:48,634 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,634 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:48,634 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf/69f134dfefc04bbca1f5ced5a7dd5dc0] hfiles 2023-07-21 05:10:48,634 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf/69f134dfefc04bbca1f5ced5a7dd5dc0 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,640 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. completed. 2023-07-21 05:10:48,640 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:10:48,640 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:48,640 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:48,640 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,640 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,640 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:10:48,652 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. completed. 2023-07-21 05:10:48,652 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:10:48,653 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:48,653 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:48,653 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,653 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,653 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:10:48,661 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,661 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,661 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,661 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,669 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,669 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,669 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,669 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:10:48,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 05:10:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39445,1689916199184': 2023-07-21 05:10:48,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 05:10:48,677 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-21 05:10:48,677 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:48,677 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:48,677 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-21 05:10:48,677 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:48,679 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,679 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,680 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,680 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,680 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,681 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,686 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,686 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,686 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,695 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,695 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,695 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,695 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,695 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,696 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,696 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-21 05:10:48,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-21 05:10:48,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,696 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,696 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,696 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,699 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,699 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,699 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:10:48,699 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,699 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:10:48,699 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:10:48,699 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,699 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 05:10:48,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,766 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689916248522Consolidate snapshot: snaptb0-testConsecutiveExports at 1689916248698 (+176 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689916248698Writing data manifest for snaptb0-testConsecutiveExports at 1689916248706 (+8 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689916248731 (+25 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689916248766 (+35 ms) 2023-07-21 05:10:48,769 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:48,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 246 msec 2023-07-21 05:10:48,825 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:48,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:48,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:48,827 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826 2023-07-21 05:10:48,827 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826, srcFsUri=hdfs://localhost:36811, srcDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:48,849 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:10:48,850 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@645c3a26, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,850 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab, snapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 05:10:48,858 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,872 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:48,872 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:48,873 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:48,874 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,809 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-872908840706536099.jar 2023-07-21 05:10:49,810 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,810 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,889 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-5673825926250309422.jar 2023-07-21 05:10:49,889 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,890 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,890 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,891 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,891 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,891 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,892 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:10:49,892 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:10:49,893 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:10:49,893 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:10:49,893 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:10:49,894 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:10:49,894 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:10:49,895 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:10:49,895 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:10:49,896 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:10:49,897 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:49,897 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:49,898 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:49,898 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:49,899 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:49,899 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:49,900 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:50,754 WARN [Listener at jenkins-hbase4.apache.org/37521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:10:50,770 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 05:10:50,773 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 05:10:51,996 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:51,996 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:51,999 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:52,680 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0003_000001 (auth:SIMPLE) 2023-07-21 05:10:52,733 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:10:57,181 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0003_000001 (auth:SIMPLE) 2023-07-21 05:10:59,444 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0003_000001 (auth:SIMPLE) 2023-07-21 05:11:01,963 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0003_000001 (auth:SIMPLE) 2023-07-21 05:11:03,967 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:11:03,967 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:11:03,971 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 05:11:03,971 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:11:03,972 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:11:03,972 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:11:03,974 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 05:11:03,974 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 05:11:03,974 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@40eb2590 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:11:03,974 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 05:11:03,974 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 05:11:03,976 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826, srcFsUri=hdfs://localhost:36811, srcDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:11:03,998 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:11:03,998 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3500db8f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:11:03,998 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab, snapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 05:11:04,008 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:11:04,019 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:04,020 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:04,020 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:04,021 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:04,997 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-4835371977422820485.jar 2023-07-21 05:11:04,998 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:04,998 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:05,067 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-1968506544959610701.jar 2023-07-21 05:11:05,067 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:05,068 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:05,068 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:05,068 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:05,069 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:05,069 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:05,069 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:11:05,070 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:11:05,070 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:11:05,071 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:11:05,071 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:11:05,071 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:11:05,072 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:11:05,072 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:11:05,072 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:11:05,073 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:11:05,073 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:05,074 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:05,074 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:05,075 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:05,075 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:05,075 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:05,076 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:05,508 WARN [Listener at jenkins-hbase4.apache.org/37521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:11:05,511 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 05:11:05,513 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 05:11:08,167 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:08,167 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:08,171 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0003_000001 (auth:SIMPLE) 2023-07-21 05:11:09,030 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:15,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:18,213 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:21,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:22,753 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:11:22,754 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:11:22,758 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 05:11:22,758 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:11:22,759 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:11:22,759 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:11:22,763 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 05:11:22,763 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 05:11:22,763 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@40eb2590 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:11:22,763 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 05:11:22,764 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/local-export-1689916248826/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 05:11:22,779 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-21 05:11:22,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-21 05:11:22,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:22,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 05:11:22,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916282800"}]},"ts":"1689916282800"} 2023-07-21 05:11:22,807 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-21 05:11:22,809 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-21 05:11:22,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7edf2af77112494fb4d9005d0616c626, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d026947b378b421654c91f05be664aa, UNASSIGN}] 2023-07-21 05:11:22,814 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7edf2af77112494fb4d9005d0616c626, UNASSIGN 2023-07-21 05:11:22,814 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d026947b378b421654c91f05be664aa, UNASSIGN 2023-07-21 05:11:22,816 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7edf2af77112494fb4d9005d0616c626, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:22,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8d026947b378b421654c91f05be664aa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:22,816 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916282816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916282816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916282816"}]},"ts":"1689916282816"} 2023-07-21 05:11:22,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916282816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916282816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916282816"}]},"ts":"1689916282816"} 2023-07-21 05:11:22,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 7edf2af77112494fb4d9005d0616c626, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:11:22,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 8d026947b378b421654c91f05be664aa, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:11:22,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 05:11:22,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7edf2af77112494fb4d9005d0616c626 2023-07-21 05:11:22,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7edf2af77112494fb4d9005d0616c626, disabling compactions & flushes 2023-07-21 05:11:22,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:11:22,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:11:22,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. after waiting 0 ms 2023-07-21 05:11:22,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:11:22,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8d026947b378b421654c91f05be664aa 2023-07-21 05:11:22,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8d026947b378b421654c91f05be664aa, disabling compactions & flushes 2023-07-21 05:11:22,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:11:22,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:11:22,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. after waiting 0 ms 2023-07-21 05:11:22,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:11:22,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:22,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:23,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626. 2023-07-21 05:11:23,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7edf2af77112494fb4d9005d0616c626: 2023-07-21 05:11:23,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:23,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7edf2af77112494fb4d9005d0616c626 2023-07-21 05:11:23,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:23,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa. 2023-07-21 05:11:23,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8d026947b378b421654c91f05be664aa: 2023-07-21 05:11:23,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7edf2af77112494fb4d9005d0616c626, regionState=CLOSED 2023-07-21 05:11:23,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916283005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916283005"}]},"ts":"1689916283005"} 2023-07-21 05:11:23,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8d026947b378b421654c91f05be664aa 2023-07-21 05:11:23,008 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8d026947b378b421654c91f05be664aa, regionState=CLOSED 2023-07-21 05:11:23,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916283008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916283008"}]},"ts":"1689916283008"} 2023-07-21 05:11:23,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-21 05:11:23,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 7edf2af77112494fb4d9005d0616c626, server=jenkins-hbase4.apache.org,36249,1689916199318 in 191 msec 2023-07-21 05:11:23,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-21 05:11:23,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 8d026947b378b421654c91f05be664aa, server=jenkins-hbase4.apache.org,39445,1689916199184 in 193 msec 2023-07-21 05:11:23,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7edf2af77112494fb4d9005d0616c626, UNASSIGN in 204 msec 2023-07-21 05:11:23,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-21 05:11:23,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d026947b378b421654c91f05be664aa, UNASSIGN in 205 msec 2023-07-21 05:11:23,023 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916283023"}]},"ts":"1689916283023"} 2023-07-21 05:11:23,027 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-21 05:11:23,029 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-21 05:11:23,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 250 msec 2023-07-21 05:11:23,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 05:11:23,099 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-21 05:11:23,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-21 05:11:23,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:23,103 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:23,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-21 05:11:23,104 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:23,107 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-21 05:11:23,110 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:23,110 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:23,110 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:23,110 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:23,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 05:11:23,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 05:11:23,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 05:11:23,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 05:11:23,112 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:23,112 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:23,112 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:23,112 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,112 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,112 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:23,112 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,112 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 05:11:23,118 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626 2023-07-21 05:11:23,119 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa 2023-07-21 05:11:23,121 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/recovered.edits] 2023-07-21 05:11:23,121 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/recovered.edits] 2023-07-21 05:11:23,126 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf/3e6c88ea1a2d41dc9c084a0756215555 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/cf/3e6c88ea1a2d41dc9c084a0756215555 2023-07-21 05:11:23,127 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf/69f134dfefc04bbca1f5ced5a7dd5dc0 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/cf/69f134dfefc04bbca1f5ced5a7dd5dc0 2023-07-21 05:11:23,130 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626/recovered.edits/9.seqid 2023-07-21 05:11:23,130 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa/recovered.edits/9.seqid 2023-07-21 05:11:23,131 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/7edf2af77112494fb4d9005d0616c626 2023-07-21 05:11:23,131 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testConsecutiveExports/8d026947b378b421654c91f05be664aa 2023-07-21 05:11:23,131 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 05:11:23,134 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:23,137 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-21 05:11:23,140 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-21 05:11:23,142 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:23,142 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-21 05:11:23,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916283142"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:23,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916283142"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:23,144 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:11:23,144 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7edf2af77112494fb4d9005d0616c626, NAME => 'testtb-testConsecutiveExports,,1689916247439.7edf2af77112494fb4d9005d0616c626.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8d026947b378b421654c91f05be664aa, NAME => 'testtb-testConsecutiveExports,1,1689916247439.8d026947b378b421654c91f05be664aa.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:11:23,144 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-21 05:11:23,144 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916283144"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:23,146 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-21 05:11:23,148 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:23,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 48 msec 2023-07-21 05:11:23,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 05:11:23,215 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-21 05:11:23,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-21 05:11:23,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-21 05:11:23,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-21 05:11:23,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-21 05:11:23,262 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=744 (was 761), OpenFileDescriptor=892 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=476 (was 455) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=1908 (was 2511) 2023-07-21 05:11:23,263 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-21 05:11:23,286 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=476, ProcessCount=185, AvailableMemoryMB=1907 2023-07-21 05:11:23,287 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-21 05:11:23,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:11:23,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:23,293 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:11:23,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-21 05:11:23,294 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:11:23,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:23,297 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,297 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,297 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c empty. 2023-07-21 05:11:23,297 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e empty. 2023-07-21 05:11:23,298 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,298 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,298 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 05:11:23,311 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-21 05:11:23,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9be888b1af3a1aec0ced472e2f824b1c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:11:23,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => ecbe3daebfb546e9b9915a70bca6d23e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:11:23,337 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:23,337 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:23,337 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing ecbe3daebfb546e9b9915a70bca6d23e, disabling compactions & flushes 2023-07-21 05:11:23,337 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9be888b1af3a1aec0ced472e2f824b1c, disabling compactions & flushes 2023-07-21 05:11:23,337 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:23,338 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:23,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:23,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:23,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. after waiting 0 ms 2023-07-21 05:11:23,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. after waiting 0 ms 2023-07-21 05:11:23,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:23,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:23,338 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:23,338 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:23,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for ecbe3daebfb546e9b9915a70bca6d23e: 2023-07-21 05:11:23,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9be888b1af3a1aec0ced472e2f824b1c: 2023-07-21 05:11:23,342 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:11:23,343 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916283343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916283343"}]},"ts":"1689916283343"} 2023-07-21 05:11:23,343 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916283343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916283343"}]},"ts":"1689916283343"} 2023-07-21 05:11:23,349 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:11:23,350 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:11:23,351 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916283350"}]},"ts":"1689916283350"} 2023-07-21 05:11:23,357 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-21 05:11:23,361 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:11:23,362 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:11:23,362 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:11:23,362 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:11:23,362 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:11:23,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9be888b1af3a1aec0ced472e2f824b1c, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ecbe3daebfb546e9b9915a70bca6d23e, ASSIGN}] 2023-07-21 05:11:23,365 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ecbe3daebfb546e9b9915a70bca6d23e, ASSIGN 2023-07-21 05:11:23,365 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9be888b1af3a1aec0ced472e2f824b1c, ASSIGN 2023-07-21 05:11:23,367 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ecbe3daebfb546e9b9915a70bca6d23e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36249,1689916199318; forceNewPlan=false, retain=false 2023-07-21 05:11:23,369 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9be888b1af3a1aec0ced472e2f824b1c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39445,1689916199184; forceNewPlan=false, retain=false 2023-07-21 05:11:23,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:23,517 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:11:23,520 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9be888b1af3a1aec0ced472e2f824b1c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:23,521 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916283520"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916283520"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916283520"}]},"ts":"1689916283520"} 2023-07-21 05:11:23,521 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ecbe3daebfb546e9b9915a70bca6d23e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:23,521 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916283521"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916283521"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916283521"}]},"ts":"1689916283521"} 2023-07-21 05:11:23,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 9be888b1af3a1aec0ced472e2f824b1c, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:11:23,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure ecbe3daebfb546e9b9915a70bca6d23e, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:11:23,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:23,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:23,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9be888b1af3a1aec0ced472e2f824b1c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:11:23,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:23,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. service=AccessControlService 2023-07-21 05:11:23,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ecbe3daebfb546e9b9915a70bca6d23e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:11:23,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. service=AccessControlService 2023-07-21 05:11:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:23,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,687 INFO [StoreOpener-ecbe3daebfb546e9b9915a70bca6d23e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,690 INFO [StoreOpener-9be888b1af3a1aec0ced472e2f824b1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,691 DEBUG [StoreOpener-ecbe3daebfb546e9b9915a70bca6d23e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf 2023-07-21 05:11:23,691 DEBUG [StoreOpener-ecbe3daebfb546e9b9915a70bca6d23e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf 2023-07-21 05:11:23,692 DEBUG [StoreOpener-9be888b1af3a1aec0ced472e2f824b1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf 2023-07-21 05:11:23,692 DEBUG [StoreOpener-9be888b1af3a1aec0ced472e2f824b1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf 2023-07-21 05:11:23,693 INFO [StoreOpener-ecbe3daebfb546e9b9915a70bca6d23e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecbe3daebfb546e9b9915a70bca6d23e columnFamilyName cf 2023-07-21 05:11:23,694 INFO [StoreOpener-ecbe3daebfb546e9b9915a70bca6d23e-1] regionserver.HStore(310): Store=ecbe3daebfb546e9b9915a70bca6d23e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:23,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,697 INFO [StoreOpener-9be888b1af3a1aec0ced472e2f824b1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9be888b1af3a1aec0ced472e2f824b1c columnFamilyName cf 2023-07-21 05:11:23,699 INFO [StoreOpener-9be888b1af3a1aec0ced472e2f824b1c-1] regionserver.HStore(310): Store=9be888b1af3a1aec0ced472e2f824b1c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:23,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:23,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:23,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:23,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ecbe3daebfb546e9b9915a70bca6d23e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74497394, jitterRate=0.11009767651557922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:23,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ecbe3daebfb546e9b9915a70bca6d23e: 2023-07-21 05:11:23,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e., pid=61, masterSystemTime=1689916283676 2023-07-21 05:11:23,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:23,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:23,716 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ecbe3daebfb546e9b9915a70bca6d23e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:23,716 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916283716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916283716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916283716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916283716"}]},"ts":"1689916283716"} 2023-07-21 05:11:23,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:23,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9be888b1af3a1aec0ced472e2f824b1c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70764700, jitterRate=0.05447620153427124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:23,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9be888b1af3a1aec0ced472e2f824b1c: 2023-07-21 05:11:23,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c., pid=60, masterSystemTime=1689916283675 2023-07-21 05:11:23,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-21 05:11:23,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure ecbe3daebfb546e9b9915a70bca6d23e, server=jenkins-hbase4.apache.org,36249,1689916199318 in 195 msec 2023-07-21 05:11:23,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:23,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:23,723 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9be888b1af3a1aec0ced472e2f824b1c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:23,723 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916283723"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916283723"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916283723"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916283723"}]},"ts":"1689916283723"} 2023-07-21 05:11:23,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ecbe3daebfb546e9b9915a70bca6d23e, ASSIGN in 359 msec 2023-07-21 05:11:23,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-21 05:11:23,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 9be888b1af3a1aec0ced472e2f824b1c, server=jenkins-hbase4.apache.org,39445,1689916199184 in 203 msec 2023-07-21 05:11:23,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-21 05:11:23,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9be888b1af3a1aec0ced472e2f824b1c, ASSIGN in 365 msec 2023-07-21 05:11:23,734 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:11:23,734 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916283734"}]},"ts":"1689916283734"} 2023-07-21 05:11:23,736 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-21 05:11:23,740 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:11:23,741 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-21 05:11:23,743 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 05:11:23,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,746 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:23,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 457 msec 2023-07-21 05:11:23,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:23,900 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-21 05:11:23,900 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-21 05:11:23,900 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:23,906 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-21 05:11:23,906 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:23,907 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-21 05:11:23,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:23,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916283910 (current time:1689916283910). 2023-07-21 05:11:23,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:23,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x5a55b5e7 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@472b5777, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:23,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:23,927 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:23,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a55b5e7 to 127.0.0.1:53187 2023-07-21 05:11:23,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:23,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x74fac194 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:23,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f7b861, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:23,941 DEBUG [hconnection-0x1efad787-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:23,943 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:23,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:23,948 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:23,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74fac194 to 127.0.0.1:53187 2023-07-21 05:11:23,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:23,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 05:11:23,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:23,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:23,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:23,960 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:23,961 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689916883961 2023-07-21 05:11:23,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:23,961 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:23,962 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:23,963 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:23,964 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:23,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:23,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-21 05:11:23,967 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:23,967 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689916883967 2023-07-21 05:11:23,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:23,979 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 05:11:23,979 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:23,980 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 05:11:23,981 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 05:11:24,056 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,056 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,059 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,059 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,059 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,059 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,060 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,060 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,060 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,061 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:24,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 05:11:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 05:11:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:24,062 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:24,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 05:11:24,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:24,064 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:24,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:24,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:24,066 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:24,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,067 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:24,067 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:24,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,071 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:24,071 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:24,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,073 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:24,073 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:24,073 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:24,073 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:24,073 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:24,075 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:24,075 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:24,075 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:24,075 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:24,075 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:24,075 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:24,079 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,079 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,079 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:24,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:24,081 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,082 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,082 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:24,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 05:11:24,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a9cb35a[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:24,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:24,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:24,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 05:11:24,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a9cb35a[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:24,090 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 05:11:24,090 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:11:24,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:24,095 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:24,095 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. started... 2023-07-21 05:11:24,098 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:24,098 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,098 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:24,106 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:24,112 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ecbe3daebfb546e9b9915a70bca6d23e: 2023-07-21 05:11:24,112 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:24,113 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:24,114 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. started... 2023-07-21 05:11:24,114 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,116 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:24,116 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:24,116 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9be888b1af3a1aec0ced472e2f824b1c: 2023-07-21 05:11:24,117 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,117 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:24,117 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:24,204 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. completed. 2023-07-21 05:11:24,204 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:24,204 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:24,204 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:24,204 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,204 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:24,204 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:11:24,208 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:24,208 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:24,208 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:24,208 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:24,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,213 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. completed. 2023-07-21 05:11:24,213 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,213 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:24,213 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:24,213 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,213 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:24,213 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:11:24,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:24,216 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,217 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:24,217 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:24,217 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:24,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:11:24,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 05:11:24,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:24,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:24,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:24,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:24,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:24,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39445,1689916199184': 2023-07-21 05:11:24,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 05:11:24,227 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 05:11:24,227 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:24,227 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:24,227 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,227 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:24,229 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,229 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,229 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:24,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,229 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:24,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,230 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,230 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:24,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,230 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:24,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,236 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:24,237 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,237 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,241 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,242 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,242 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,250 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,250 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,251 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,251 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,251 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,251 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:24,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,251 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:24,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,251 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,251 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,251 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,253 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,253 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,253 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,253 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,253 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:24,254 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,254 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,254 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:24,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:24,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:24,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:24,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:24,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:24,266 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:24,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:24,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:24,268 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:24,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 05:11:24,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,489 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689916283961Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689916284253 (+292 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689916284253Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689916284285 (+32 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689916284335 (+50 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689916284486 (+151 ms) 2023-07-21 05:11:24,492 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:24,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 530 msec 2023-07-21 05:11:24,568 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:24,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:24,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:24,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39445] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:24,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36249] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:24,593 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,593 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:24,593 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:24,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:24,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916284616 (current time:1689916284616). 2023-07-21 05:11:24,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:24,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x5d995bf8 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:24,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1baca400, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:24,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:24,648 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:24,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d995bf8 to 127.0.0.1:53187 2023-07-21 05:11:24,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:24,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x71c1aaa9 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:24,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@669079f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:24,667 DEBUG [hconnection-0x18625d84-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:24,676 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:24,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:24,685 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:24,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71c1aaa9 to 127.0.0.1:53187 2023-07-21 05:11:24,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:24,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 05:11:24,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:24,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:24,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:24,692 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:24,695 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689916884695 2023-07-21 05:11:24,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:24,697 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:24,697 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:24,697 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:24,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:24,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-21 05:11:24,703 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:24,704 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689916884704 2023-07-21 05:11:24,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,737 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 05:11:24,737 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:24,738 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 05:11:24,738 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 05:11:24,740 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,740 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,797 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:24,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:24,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:24,799 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:24,811 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,811 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,811 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,812 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,812 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,812 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,812 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:24,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 05:11:24,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 05:11:24,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:24,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:24,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,814 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:24,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,814 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:24,814 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:24,816 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:24,816 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:24,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:24,816 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:24,816 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:24,816 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:24,818 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:24,818 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:24,818 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:24,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,848 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,848 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 05:11:24,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:24,864 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:24,865 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,865 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:24,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:24,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:24,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 05:11:24,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7396d6c9[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:24,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,871 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:24,871 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:24,873 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:24,873 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:24,873 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:24,890 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,890 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:24,891 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:24,891 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:24,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 05:11:24,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7396d6c9[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:24,894 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 05:11:24,894 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,907 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,907 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,908 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:24,908 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,908 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:24,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:24,908 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:24,911 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:24,911 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:24,911 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:11:24,912 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:24,912 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:24,914 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:24,914 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:24,914 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:24,915 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. started... 2023-07-21 05:11:24,915 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ecbe3daebfb546e9b9915a70bca6d23e 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-21 05:11:24,915 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:24,915 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:24,915 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:24,916 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. started... 2023-07-21 05:11:24,916 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9be888b1af3a1aec0ced472e2f824b1c 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-21 05:11:24,917 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:24,917 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:24,917 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:24,982 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/.tmp/cf/6ea611d4723a419abbaa892481c2f944 2023-07-21 05:11:24,984 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/.tmp/cf/2e473c5111ff4be1ac46d624a55ed556 2023-07-21 05:11:24,992 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/.tmp/cf/2e473c5111ff4be1ac46d624a55ed556 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf/2e473c5111ff4be1ac46d624a55ed556 2023-07-21 05:11:24,995 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/.tmp/cf/6ea611d4723a419abbaa892481c2f944 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf/6ea611d4723a419abbaa892481c2f944 2023-07-21 05:11:24,999 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:25,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:25,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:25,001 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:25,005 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf/2e473c5111ff4be1ac46d624a55ed556, entries=6, sequenceid=6, filesize=5.2 K 2023-07-21 05:11:25,006 INFO [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 9be888b1af3a1aec0ced472e2f824b1c in 90ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:25,007 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-21 05:11:25,007 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9be888b1af3a1aec0ced472e2f824b1c: 2023-07-21 05:11:25,007 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,007 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:25,007 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf/2e473c5111ff4be1ac46d624a55ed556] hfiles 2023-07-21 05:11:25,008 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf/2e473c5111ff4be1ac46d624a55ed556 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,009 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf/6ea611d4723a419abbaa892481c2f944, entries=44, sequenceid=6, filesize=7.8 K 2023-07-21 05:11:25,010 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for ecbe3daebfb546e9b9915a70bca6d23e in 95ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:25,012 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ecbe3daebfb546e9b9915a70bca6d23e: 2023-07-21 05:11:25,012 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,012 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:25,012 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf/6ea611d4723a419abbaa892481c2f944] hfiles 2023-07-21 05:11:25,012 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf/6ea611d4723a419abbaa892481c2f944 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,057 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. completed. 2023-07-21 05:11:25,060 DEBUG [rs(jenkins-hbase4.apache.org,39445,1689916199184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:25,060 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:25,060 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:25,060 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,060 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:25,060 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:11:25,063 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:25,063 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,063 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:25,063 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:25,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:25,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:25,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:25,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:25,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:25,068 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. completed. 2023-07-21 05:11:25,069 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:25,069 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:25,069 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:25,069 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,069 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:25,069 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:11:25,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,071 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,071 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:25,071 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:25,071 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:25,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39445,1689916199184': 2023-07-21 05:11:25,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 05:11:25,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:25,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:25,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:25,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:25,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:25,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:11:25,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 05:11:25,078 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 05:11:25,078 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:25,078 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:25,078 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,078 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:25,084 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,084 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,084 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,084 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,084 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,084 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,084 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,085 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,085 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,086 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:25,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,092 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:25,092 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,093 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,097 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,097 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,097 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,097 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,097 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,097 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,097 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,097 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,097 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,099 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,099 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,099 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,100 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:25,100 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,100 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,100 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,100 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,100 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-21 05:11:25,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,177 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 05:11:25,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,178 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:25,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689916284695Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689916285099 (+404 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689916285099Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689916285107 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689916285124 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689916285177 (+53 ms) 2023-07-21 05:11:25,182 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:25,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 485 msec 2023-07-21 05:11:25,301 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:25,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:25,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:25,339 DEBUG [Listener at jenkins-hbase4.apache.org/37521] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:11:25,343 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:11:25,345 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36249] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 05:11:25,346 DEBUG [Listener at jenkins-hbase4.apache.org/37521] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:11:25,351 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:11:25,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39445] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 05:11:25,351 DEBUG [Listener at jenkins-hbase4.apache.org/37521] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:11:25,358 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:11:25,358 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46441] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 05:11:25,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:11:25,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,363 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:11:25,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-21 05:11:25,364 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:11:25,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 05:11:25,366 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,366 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,367 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb empty. 2023-07-21 05:11:25,367 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba empty. 2023-07-21 05:11:25,368 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,368 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,368 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 05:11:25,386 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-21 05:11:25,388 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 91c8a3e5af0277957c593bbf372c84fb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:11:25,388 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9f692ece0db36044b142551a993f36ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9f692ece0db36044b142551a993f36ba, disabling compactions & flushes 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 91c8a3e5af0277957c593bbf372c84fb, disabling compactions & flushes 2023-07-21 05:11:25,426 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:25,426 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. after waiting 0 ms 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. after waiting 0 ms 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:25,426 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:25,426 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 91c8a3e5af0277957c593bbf372c84fb: 2023-07-21 05:11:25,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9f692ece0db36044b142551a993f36ba: 2023-07-21 05:11:25,429 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:11:25,430 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916285429"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916285429"}]},"ts":"1689916285429"} 2023-07-21 05:11:25,430 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916285429"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916285429"}]},"ts":"1689916285429"} 2023-07-21 05:11:25,432 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:11:25,433 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:11:25,433 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916285433"}]},"ts":"1689916285433"} 2023-07-21 05:11:25,435 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-21 05:11:25,439 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:11:25,440 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:11:25,440 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:11:25,440 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:11:25,440 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:11:25,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c8a3e5af0277957c593bbf372c84fb, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f692ece0db36044b142551a993f36ba, ASSIGN}] 2023-07-21 05:11:25,443 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f692ece0db36044b142551a993f36ba, ASSIGN 2023-07-21 05:11:25,443 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c8a3e5af0277957c593bbf372c84fb, ASSIGN 2023-07-21 05:11:25,444 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f692ece0db36044b142551a993f36ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36249,1689916199318; forceNewPlan=false, retain=false 2023-07-21 05:11:25,444 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c8a3e5af0277957c593bbf372c84fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46441,1689916199266; forceNewPlan=false, retain=false 2023-07-21 05:11:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 05:11:25,595 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:11:25,597 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9f692ece0db36044b142551a993f36ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,597 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=91c8a3e5af0277957c593bbf372c84fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,598 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916285597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916285597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916285597"}]},"ts":"1689916285597"} 2023-07-21 05:11:25,598 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916285597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916285597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916285597"}]},"ts":"1689916285597"} 2023-07-21 05:11:25,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 91c8a3e5af0277957c593bbf372c84fb, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:11:25,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 9f692ece0db36044b142551a993f36ba, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:11:25,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 05:11:25,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:25,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f692ece0db36044b142551a993f36ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.', STARTKEY => '2', ENDKEY => ''} 2023-07-21 05:11:25,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:25,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91c8a3e5af0277957c593bbf372c84fb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.', STARTKEY => '', ENDKEY => '2'} 2023-07-21 05:11:25,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. service=AccessControlService 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. service=AccessControlService 2023-07-21 05:11:25,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,762 INFO [StoreOpener-91c8a3e5af0277957c593bbf372c84fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,762 INFO [StoreOpener-9f692ece0db36044b142551a993f36ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,765 DEBUG [StoreOpener-91c8a3e5af0277957c593bbf372c84fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf 2023-07-21 05:11:25,765 DEBUG [StoreOpener-91c8a3e5af0277957c593bbf372c84fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf 2023-07-21 05:11:25,765 INFO [StoreOpener-91c8a3e5af0277957c593bbf372c84fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91c8a3e5af0277957c593bbf372c84fb columnFamilyName cf 2023-07-21 05:11:25,765 DEBUG [StoreOpener-9f692ece0db36044b142551a993f36ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf 2023-07-21 05:11:25,765 DEBUG [StoreOpener-9f692ece0db36044b142551a993f36ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf 2023-07-21 05:11:25,766 INFO [StoreOpener-91c8a3e5af0277957c593bbf372c84fb-1] regionserver.HStore(310): Store=91c8a3e5af0277957c593bbf372c84fb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:25,766 INFO [StoreOpener-9f692ece0db36044b142551a993f36ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f692ece0db36044b142551a993f36ba columnFamilyName cf 2023-07-21 05:11:25,766 INFO [StoreOpener-9f692ece0db36044b142551a993f36ba-1] regionserver.HStore(310): Store=9f692ece0db36044b142551a993f36ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:25,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:25,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:25,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:25,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:25,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91c8a3e5af0277957c593bbf372c84fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72451357, jitterRate=0.07960934937000275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:25,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f692ece0db36044b142551a993f36ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74895796, jitterRate=0.11603432893753052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:25,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91c8a3e5af0277957c593bbf372c84fb: 2023-07-21 05:11:25,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f692ece0db36044b142551a993f36ba: 2023-07-21 05:11:25,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb., pid=69, masterSystemTime=1689916285752 2023-07-21 05:11:25,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba., pid=70, masterSystemTime=1689916285752 2023-07-21 05:11:25,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:25,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:25,776 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9f692ece0db36044b142551a993f36ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:25,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:25,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:25,776 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916285776"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916285776"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916285776"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916285776"}]},"ts":"1689916285776"} 2023-07-21 05:11:25,777 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=91c8a3e5af0277957c593bbf372c84fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:25,777 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916285777"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916285777"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916285777"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916285777"}]},"ts":"1689916285777"} 2023-07-21 05:11:25,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-21 05:11:25,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 9f692ece0db36044b142551a993f36ba, server=jenkins-hbase4.apache.org,36249,1689916199318 in 177 msec 2023-07-21 05:11:25,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-21 05:11:25,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 91c8a3e5af0277957c593bbf372c84fb, server=jenkins-hbase4.apache.org,46441,1689916199266 in 179 msec 2023-07-21 05:11:25,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f692ece0db36044b142551a993f36ba, ASSIGN in 340 msec 2023-07-21 05:11:25,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-21 05:11:25,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c8a3e5af0277957c593bbf372c84fb, ASSIGN in 342 msec 2023-07-21 05:11:25,784 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:11:25,784 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916285784"}]},"ts":"1689916285784"} 2023-07-21 05:11:25,785 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-21 05:11:25,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:11:25,789 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-21 05:11:25,791 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 05:11:25,792 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:25,792 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:25,792 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:25,792 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:25,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:25,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:25,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:25,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:25,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:25,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:25,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:25,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:25,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 433 msec 2023-07-21 05:11:25,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 05:11:25,969 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-21 05:11:25,972 DEBUG [Listener at jenkins-hbase4.apache.org/37521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:25,976 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:26,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 91c8a3e5af0277957c593bbf372c84fb, 9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:26,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c8a3e5af0277957c593bbf372c84fb, 9f692ece0db36044b142551a993f36ba], force=true 2023-07-21 05:11:26,015 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c8a3e5af0277957c593bbf372c84fb, 9f692ece0db36044b142551a993f36ba], force=true 2023-07-21 05:11:26,015 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c8a3e5af0277957c593bbf372c84fb, 9f692ece0db36044b142551a993f36ba], force=true 2023-07-21 05:11:26,015 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c8a3e5af0277957c593bbf372c84fb, 9f692ece0db36044b142551a993f36ba], force=true 2023-07-21 05:11:26,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:26,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c8a3e5af0277957c593bbf372c84fb, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f692ece0db36044b142551a993f36ba, UNASSIGN}] 2023-07-21 05:11:26,051 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c8a3e5af0277957c593bbf372c84fb, UNASSIGN 2023-07-21 05:11:26,052 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=91c8a3e5af0277957c593bbf372c84fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:26,052 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916286052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916286052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916286052"}]},"ts":"1689916286052"} 2023-07-21 05:11:26,055 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f692ece0db36044b142551a993f36ba, UNASSIGN 2023-07-21 05:11:26,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 91c8a3e5af0277957c593bbf372c84fb, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:11:26,059 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9f692ece0db36044b142551a993f36ba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:26,060 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916286059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916286059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916286059"}]},"ts":"1689916286059"} 2023-07-21 05:11:26,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 9f692ece0db36044b142551a993f36ba, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:11:26,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:26,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:26,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91c8a3e5af0277957c593bbf372c84fb, disabling compactions & flushes 2023-07-21 05:11:26,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:26,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:26,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. after waiting 0 ms 2023-07-21 05:11:26,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:26,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 91c8a3e5af0277957c593bbf372c84fb 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 05:11:26,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:26,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f692ece0db36044b142551a993f36ba, disabling compactions & flushes 2023-07-21 05:11:26,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:26,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:26,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. after waiting 0 ms 2023-07-21 05:11:26,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:26,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9f692ece0db36044b142551a993f36ba 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 05:11:26,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/.tmp/cf/d993795a5de04c02bff5158fcc7f1f21 2023-07-21 05:11:26,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/.tmp/cf/d993795a5de04c02bff5158fcc7f1f21 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf/d993795a5de04c02bff5158fcc7f1f21 2023-07-21 05:11:26,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/.tmp/cf/78c279ab314d448a81d2ed1ef017d18e 2023-07-21 05:11:26,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf/d993795a5de04c02bff5158fcc7f1f21, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 05:11:26,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 91c8a3e5af0277957c593bbf372c84fb in 70ms, sequenceid=5, compaction requested=false 2023-07-21 05:11:26,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 05:11:26,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/.tmp/cf/78c279ab314d448a81d2ed1ef017d18e as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf/78c279ab314d448a81d2ed1ef017d18e 2023-07-21 05:11:26,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 05:11:26,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:26,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb. 2023-07-21 05:11:26,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91c8a3e5af0277957c593bbf372c84fb: 2023-07-21 05:11:26,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:26,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf/78c279ab314d448a81d2ed1ef017d18e, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 05:11:26,300 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=91c8a3e5af0277957c593bbf372c84fb, regionState=CLOSED 2023-07-21 05:11:26,300 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916286300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916286300"}]},"ts":"1689916286300"} 2023-07-21 05:11:26,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9f692ece0db36044b142551a993f36ba in 73ms, sequenceid=5, compaction requested=false 2023-07-21 05:11:26,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-21 05:11:26,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 91c8a3e5af0277957c593bbf372c84fb, server=jenkins-hbase4.apache.org,46441,1689916199266 in 252 msec 2023-07-21 05:11:26,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91c8a3e5af0277957c593bbf372c84fb, UNASSIGN in 265 msec 2023-07-21 05:11:26,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 05:11:26,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:26,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba. 2023-07-21 05:11:26,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f692ece0db36044b142551a993f36ba: 2023-07-21 05:11:26,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:26,312 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9f692ece0db36044b142551a993f36ba, regionState=CLOSED 2023-07-21 05:11:26,313 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916286312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916286312"}]},"ts":"1689916286312"} 2023-07-21 05:11:26,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-21 05:11:26,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 9f692ece0db36044b142551a993f36ba, server=jenkins-hbase4.apache.org,36249,1689916199318 in 251 msec 2023-07-21 05:11:26,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-21 05:11:26,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f692ece0db36044b142551a993f36ba, UNASSIGN in 267 msec 2023-07-21 05:11:26,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:26,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:26,790 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-21 05:11:26,796 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285360.91c8a3e5af0277957c593bbf372c84fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:26,796 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916285360.9f692ece0db36044b142551a993f36ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:26,796 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:26,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6fb890b7dcdd33aaf706545830fad52a, ASSIGN}] 2023-07-21 05:11:26,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6fb890b7dcdd33aaf706545830fad52a, ASSIGN 2023-07-21 05:11:26,868 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6fb890b7dcdd33aaf706545830fad52a, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46441,1689916199266; forceNewPlan=false, retain=false 2023-07-21 05:11:27,018 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 05:11:27,020 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6fb890b7dcdd33aaf706545830fad52a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:27,020 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689916287020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916287020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916287020"}]},"ts":"1689916287020"} 2023-07-21 05:11:27,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 6fb890b7dcdd33aaf706545830fad52a, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:11:27,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:27,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:27,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fb890b7dcdd33aaf706545830fad52a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:11:27,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. service=AccessControlService 2023-07-21 05:11:27,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:27,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:27,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:27,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:27,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:27,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/.regioninfo 2023-07-21 05:11:27,189 INFO [StoreOpener-6fb890b7dcdd33aaf706545830fad52a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:27,190 DEBUG [StoreOpener-6fb890b7dcdd33aaf706545830fad52a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf 2023-07-21 05:11:27,190 DEBUG [StoreOpener-6fb890b7dcdd33aaf706545830fad52a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf 2023-07-21 05:11:27,191 INFO [StoreOpener-6fb890b7dcdd33aaf706545830fad52a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fb890b7dcdd33aaf706545830fad52a columnFamilyName cf 2023-07-21 05:11:27,228 DEBUG [StoreOpener-6fb890b7dcdd33aaf706545830fad52a-1] regionserver.HStore(539): loaded hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/78c279ab314d448a81d2ed1ef017d18e.9f692ece0db36044b142551a993f36ba->hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf/78c279ab314d448a81d2ed1ef017d18e-top 2023-07-21 05:11:27,236 DEBUG [StoreOpener-6fb890b7dcdd33aaf706545830fad52a-1] regionserver.HStore(539): loaded hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/d993795a5de04c02bff5158fcc7f1f21.91c8a3e5af0277957c593bbf372c84fb->hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf/d993795a5de04c02bff5158fcc7f1f21-top 2023-07-21 05:11:27,237 INFO [StoreOpener-6fb890b7dcdd33aaf706545830fad52a-1] regionserver.HStore(310): Store=6fb890b7dcdd33aaf706545830fad52a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:27,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:27,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:27,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:27,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6fb890b7dcdd33aaf706545830fad52a; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60090008, jitterRate=-0.10458910465240479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:27,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6fb890b7dcdd33aaf706545830fad52a: 2023-07-21 05:11:27,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a., pid=77, masterSystemTime=1689916287174 2023-07-21 05:11:27,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.,because compaction is disabled. 2023-07-21 05:11:27,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:27,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:27,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6fb890b7dcdd33aaf706545830fad52a, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:27,253 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689916287253"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916287253"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916287253"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916287253"}]},"ts":"1689916287253"} 2023-07-21 05:11:27,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-21 05:11:27,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 6fb890b7dcdd33aaf706545830fad52a, server=jenkins-hbase4.apache.org,46441,1689916199266 in 233 msec 2023-07-21 05:11:27,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-21 05:11:27,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6fb890b7dcdd33aaf706545830fad52a, ASSIGN in 394 msec 2023-07-21 05:11:27,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[91c8a3e5af0277957c593bbf372c84fb, 9f692ece0db36044b142551a993f36ba], force=true in 1.2540 sec 2023-07-21 05:11:27,863 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:28,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:28,136 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-21 05:11:28,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 05:11:28,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916288137 (current time:1689916288137). 2023-07-21 05:11:28,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:28,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x4686ebcb to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:28,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1963d8f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:28,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:28,164 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:28,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4686ebcb to 127.0.0.1:53187 2023-07-21 05:11:28,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:28,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x6420c0e3 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:28,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1509b71f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:28,192 DEBUG [hconnection-0x122a7129-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:28,197 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:28,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:28,216 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:28,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6420c0e3 to 127.0.0.1:53187 2023-07-21 05:11:28,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:28,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 05:11:28,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:28,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 05:11:28,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 05:11:28,222 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 05:11:28,223 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689916888223 2023-07-21 05:11:28,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 05:11:28,223 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,228 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:28,228 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:28,229 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 05:11:28,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 05:11:28,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-21 05:11:28,232 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 05:11:28,232 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689916888232 2023-07-21 05:11:28,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,256 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 05:11:28,256 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:28,259 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-21 05:11:28,259 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-21 05:11:28,319 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,320 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,321 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:28,321 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:28,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:28,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:28,322 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,322 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,324 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,324 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:28,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 05:11:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 05:11:28,329 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:28,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 05:11:28,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:28,330 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:28,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,335 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 05:11:28,335 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 05:11:28,335 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:28,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,335 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:28,335 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 05:11:28,335 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 05:11:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 05:11:28,340 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,340 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,340 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:28,341 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,341 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,341 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:28,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-21 05:11:28,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1680e475[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:28,345 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-21 05:11:28,345 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,350 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 05:11:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,351 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,351 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 05:11:28,351 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 05:11:28,351 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 05:11:28,351 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 05:11:28,352 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:11:28,352 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:11:28,353 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 05:11:28,353 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 05:11:28,354 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:28,354 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:28,354 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:28,354 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 05:11:28,353 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:28,354 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 05:11:28,354 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. started... 2023-07-21 05:11:28,360 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:28,362 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6fb890b7dcdd33aaf706545830fad52a: 2023-07-21 05:11:28,362 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,362 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:28,363 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/78c279ab314d448a81d2ed1ef017d18e.9f692ece0db36044b142551a993f36ba->hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf/78c279ab314d448a81d2ed1ef017d18e-top, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/d993795a5de04c02bff5158fcc7f1f21.91c8a3e5af0277957c593bbf372c84fb->hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf/d993795a5de04c02bff5158fcc7f1f21-top] hfiles 2023-07-21 05:11:28,363 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/78c279ab314d448a81d2ed1ef017d18e.9f692ece0db36044b142551a993f36ba for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,364 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/d993795a5de04c02bff5158fcc7f1f21.91c8a3e5af0277957c593bbf372c84fb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,377 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. completed. 2023-07-21 05:11:28,377 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:28,377 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:28,377 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:28,377 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,377 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 05:11:28,377 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:11:28,387 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 05:11:28,387 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,387 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:28,387 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 05:11:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:28,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:28,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:28,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46441,1689916199266': 2023-07-21 05:11:28,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-21 05:11:28,392 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-21 05:11:28,392 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:28,392 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:28,392 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,392 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:28,394 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,395 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:28,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,394 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,395 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:28,395 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,395 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,395 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,396 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:28,395 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:28,396 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:28,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:28,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:28,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,398 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:28,398 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,398 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:28,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:28,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:28,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:28,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:28,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:28,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:28,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:28,404 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:28,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:28,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:28,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:28,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:28,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,403 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:28,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:28,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-21 05:11:28,405 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:28,409 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,409 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:28,409 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:28,409 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,409 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,530 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:28,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 05:11:28,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:28,532 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:28,601 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:11:28,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-21 05:11:28,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,603 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689916288224Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689916288404 (+180 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689916288404Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689916288409 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689916288440 (+31 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689916288602 (+162 ms) 2023-07-21 05:11:28,625 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 05:11:28,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 397 msec 2023-07-21 05:11:28,832 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:28,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 05:11:28,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:28,834 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834 2023-07-21 05:11:28,834 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36811, tgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834, rawTgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834, srcFsUri=hdfs://localhost:36811, srcDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:11:28,861 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:11:28,861 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-932572452_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,861 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab, snapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-21 05:11:28,876 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:28,942 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:28,942 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:28,943 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:28,943 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,069 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-2046355216108624143.jar 2023-07-21 05:11:30,070 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,071 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,157 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-2720102787407033581.jar 2023-07-21 05:11:30,158 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,159 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,159 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,160 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,161 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,161 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:30,162 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:11:30,162 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:11:30,162 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:11:30,163 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:11:30,163 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:11:30,164 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:11:30,164 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:11:30,164 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:11:30,165 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:11:30,165 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:11:30,166 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:30,166 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:30,167 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:30,168 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:30,168 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:30,169 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:30,169 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:32,298 WARN [Listener at jenkins-hbase4.apache.org/37521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:11:32,303 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-21 05:11:32,306 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-21 05:11:32,527 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:32,527 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:32,909 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:39,157 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:41,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:44,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:46,700 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:11:46,705 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:11:46,723 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:46,723 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:11:46,724 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:11:46,728 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 05:11:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 05:11:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 05:11:46,730 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916288834/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 05:11:46,739 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:46,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:46,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:46,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 05:11:46,745 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916306744"}]},"ts":"1689916306744"} 2023-07-21 05:11:46,746 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-21 05:11:46,748 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-21 05:11:46,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6fb890b7dcdd33aaf706545830fad52a, UNASSIGN}] 2023-07-21 05:11:46,753 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6fb890b7dcdd33aaf706545830fad52a, UNASSIGN 2023-07-21 05:11:46,754 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6fb890b7dcdd33aaf706545830fad52a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:46,755 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689916306754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916306754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916306754"}]},"ts":"1689916306754"} 2023-07-21 05:11:46,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 6fb890b7dcdd33aaf706545830fad52a, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:11:46,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 05:11:46,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:46,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6fb890b7dcdd33aaf706545830fad52a, disabling compactions & flushes 2023-07-21 05:11:46,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:46,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:46,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. after waiting 0 ms 2023-07-21 05:11:46,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:46,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-21 05:11:46,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:46,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a. 2023-07-21 05:11:46,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6fb890b7dcdd33aaf706545830fad52a: 2023-07-21 05:11:46,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:46,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6fb890b7dcdd33aaf706545830fad52a, regionState=CLOSED 2023-07-21 05:11:46,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689916306948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916306948"}]},"ts":"1689916306948"} 2023-07-21 05:11:46,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-21 05:11:46,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 6fb890b7dcdd33aaf706545830fad52a, server=jenkins-hbase4.apache.org,46441,1689916199266 in 194 msec 2023-07-21 05:11:46,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-21 05:11:46,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6fb890b7dcdd33aaf706545830fad52a, UNASSIGN in 203 msec 2023-07-21 05:11:46,959 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916306959"}]},"ts":"1689916306959"} 2023-07-21 05:11:46,960 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-21 05:11:46,963 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-21 05:11:46,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 224 msec 2023-07-21 05:11:47,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 05:11:47,047 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-21 05:11:47,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,053 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,055 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,059 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,059 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,059 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 05:11:47,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 05:11:47,060 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:47,060 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,060 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,060 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:47,060 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:47,061 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-21 05:11:47,060 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:47,060 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-21 05:11:47,061 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:11:47,061 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:47,061 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:11:47,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 05:11:47,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:47,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:47,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:47,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:47,066 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:47,066 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:47,068 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/recovered.edits] 2023-07-21 05:11:47,068 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/recovered.edits] 2023-07-21 05:11:47,069 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/recovered.edits] 2023-07-21 05:11:47,079 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf/78c279ab314d448a81d2ed1ef017d18e to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/cf/78c279ab314d448a81d2ed1ef017d18e 2023-07-21 05:11:47,079 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/78c279ab314d448a81d2ed1ef017d18e.9f692ece0db36044b142551a993f36ba to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/78c279ab314d448a81d2ed1ef017d18e.9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:47,081 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf/d993795a5de04c02bff5158fcc7f1f21 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/cf/d993795a5de04c02bff5158fcc7f1f21 2023-07-21 05:11:47,084 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/d993795a5de04c02bff5158fcc7f1f21.91c8a3e5af0277957c593bbf372c84fb to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/cf/d993795a5de04c02bff5158fcc7f1f21.91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:47,084 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/recovered.edits/8.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba/recovered.edits/8.seqid 2023-07-21 05:11:47,085 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f692ece0db36044b142551a993f36ba 2023-07-21 05:11:47,086 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/recovered.edits/8.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb/recovered.edits/8.seqid 2023-07-21 05:11:47,087 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91c8a3e5af0277957c593bbf372c84fb 2023-07-21 05:11:47,088 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/recovered.edits/12.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a/recovered.edits/12.seqid 2023-07-21 05:11:47,088 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6fb890b7dcdd33aaf706545830fad52a 2023-07-21 05:11:47,088 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 05:11:47,091 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,094 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-21 05:11:47,096 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-21 05:11:47,098 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,098 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-21 05:11:47,098 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916307098"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:47,111 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-21 05:11:47,111 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6fb890b7dcdd33aaf706545830fad52a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916285361.6fb890b7dcdd33aaf706545830fad52a.', STARTKEY => '', ENDKEY => ''}] 2023-07-21 05:11:47,111 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-21 05:11:47,111 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916307111"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:47,133 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-21 05:11:47,137 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 88 msec 2023-07-21 05:11:47,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 05:11:47,163 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-21 05:11:47,164 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 05:11:47,175 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916307174"}]},"ts":"1689916307174"} 2023-07-21 05:11:47,177 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-21 05:11:47,179 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-21 05:11:47,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9be888b1af3a1aec0ced472e2f824b1c, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ecbe3daebfb546e9b9915a70bca6d23e, UNASSIGN}] 2023-07-21 05:11:47,185 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9be888b1af3a1aec0ced472e2f824b1c, UNASSIGN 2023-07-21 05:11:47,185 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ecbe3daebfb546e9b9915a70bca6d23e, UNASSIGN 2023-07-21 05:11:47,187 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ecbe3daebfb546e9b9915a70bca6d23e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:47,187 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9be888b1af3a1aec0ced472e2f824b1c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:47,187 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916307187"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916307187"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916307187"}]},"ts":"1689916307187"} 2023-07-21 05:11:47,188 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916307187"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916307187"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916307187"}]},"ts":"1689916307187"} 2023-07-21 05:11:47,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure ecbe3daebfb546e9b9915a70bca6d23e, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:11:47,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 9be888b1af3a1aec0ced472e2f824b1c, server=jenkins-hbase4.apache.org,39445,1689916199184}] 2023-07-21 05:11:47,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 05:11:47,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:47,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ecbe3daebfb546e9b9915a70bca6d23e, disabling compactions & flushes 2023-07-21 05:11:47,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:47,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:47,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. after waiting 0 ms 2023-07-21 05:11:47,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:47,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:47,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9be888b1af3a1aec0ced472e2f824b1c, disabling compactions & flushes 2023-07-21 05:11:47,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:47,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:47,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. after waiting 0 ms 2023-07-21 05:11:47,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:47,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:47,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:47,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:47,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:47,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e. 2023-07-21 05:11:47,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ecbe3daebfb546e9b9915a70bca6d23e: 2023-07-21 05:11:47,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c. 2023-07-21 05:11:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9be888b1af3a1aec0ced472e2f824b1c: 2023-07-21 05:11:47,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:47,400 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ecbe3daebfb546e9b9915a70bca6d23e, regionState=CLOSED 2023-07-21 05:11:47,400 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916307399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916307399"}]},"ts":"1689916307399"} 2023-07-21 05:11:47,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:47,400 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9be888b1af3a1aec0ced472e2f824b1c, regionState=CLOSED 2023-07-21 05:11:47,400 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916307400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916307400"}]},"ts":"1689916307400"} 2023-07-21 05:11:47,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-21 05:11:47,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure ecbe3daebfb546e9b9915a70bca6d23e, server=jenkins-hbase4.apache.org,36249,1689916199318 in 211 msec 2023-07-21 05:11:47,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-21 05:11:47,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 9be888b1af3a1aec0ced472e2f824b1c, server=jenkins-hbase4.apache.org,39445,1689916199184 in 210 msec 2023-07-21 05:11:47,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ecbe3daebfb546e9b9915a70bca6d23e, UNASSIGN in 224 msec 2023-07-21 05:11:47,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-21 05:11:47,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9be888b1af3a1aec0ced472e2f824b1c, UNASSIGN in 225 msec 2023-07-21 05:11:47,407 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916307407"}]},"ts":"1689916307407"} 2023-07-21 05:11:47,408 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-21 05:11:47,411 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-21 05:11:47,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 247 msec 2023-07-21 05:11:47,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 05:11:47,477 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-21 05:11:47,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,483 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,485 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,487 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,492 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:47,492 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:47,496 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,496 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,496 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,496 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,496 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/recovered.edits] 2023-07-21 05:11:47,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 05:11:47,496 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/recovered.edits] 2023-07-21 05:11:47,497 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 05:11:47,497 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 05:11:47,497 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 05:11:47,498 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,498 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,498 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:47,498 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,498 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:47,498 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:47,498 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,499 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:47,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 05:11:47,503 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf/6ea611d4723a419abbaa892481c2f944 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/cf/6ea611d4723a419abbaa892481c2f944 2023-07-21 05:11:47,504 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf/2e473c5111ff4be1ac46d624a55ed556 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/cf/2e473c5111ff4be1ac46d624a55ed556 2023-07-21 05:11:47,509 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c/recovered.edits/9.seqid 2023-07-21 05:11:47,509 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e/recovered.edits/9.seqid 2023-07-21 05:11:47,510 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9be888b1af3a1aec0ced472e2f824b1c 2023-07-21 05:11:47,510 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ecbe3daebfb546e9b9915a70bca6d23e 2023-07-21 05:11:47,510 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 05:11:47,514 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,517 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-21 05:11:47,519 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-21 05:11:47,526 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,526 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-21 05:11:47,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916307526"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:47,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916307526"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:47,528 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:11:47,529 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9be888b1af3a1aec0ced472e2f824b1c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689916283288.9be888b1af3a1aec0ced472e2f824b1c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ecbe3daebfb546e9b9915a70bca6d23e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916283288.ecbe3daebfb546e9b9915a70bca6d23e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:11:47,529 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-21 05:11:47,529 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916307529"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:47,530 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-21 05:11:47,534 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 55 msec 2023-07-21 05:11:47,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 05:11:47,601 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-21 05:11:47,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 05:11:47,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 05:11:47,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:47,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-21 05:11:47,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:47,674 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 744) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:58214 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3832 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:39865 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:33868 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:35328 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_559404720_1 at /127.0.0.1:35310 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_559404720_1 at /127.0.0.1:58186 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=710 (was 476) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=1770 (was 1907) 2023-07-21 05:11:47,675 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-21 05:11:47,706 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=710, ProcessCount=185, AvailableMemoryMB=1769 2023-07-21 05:11:47,706 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-21 05:11:47,709 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:11:47,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:47,716 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:11:47,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-21 05:11:47,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 05:11:47,718 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:11:47,721 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:47,721 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:47,722 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199 empty. 2023-07-21 05:11:47,722 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb empty. 2023-07-21 05:11:47,722 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:47,722 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:47,722 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 05:11:47,735 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 05:11:47,737 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 95d31255826d43ad9ab40bdc41fba199, NAME => 'testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:11:47,739 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a516a88a0b508abf63a58a07e82ccadb, NAME => 'testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:11:47,786 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:47,787 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a516a88a0b508abf63a58a07e82ccadb, disabling compactions & flushes 2023-07-21 05:11:47,787 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:47,787 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:47,787 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. after waiting 0 ms 2023-07-21 05:11:47,787 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:47,787 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:47,787 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a516a88a0b508abf63a58a07e82ccadb: 2023-07-21 05:11:47,795 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:47,795 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 95d31255826d43ad9ab40bdc41fba199, disabling compactions & flushes 2023-07-21 05:11:47,795 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:47,795 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:47,795 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. after waiting 0 ms 2023-07-21 05:11:47,795 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:47,795 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:47,795 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 95d31255826d43ad9ab40bdc41fba199: 2023-07-21 05:11:47,798 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:11:47,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916307799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916307799"}]},"ts":"1689916307799"} 2023-07-21 05:11:47,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916307799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916307799"}]},"ts":"1689916307799"} 2023-07-21 05:11:47,802 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:11:47,803 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:11:47,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916307803"}]},"ts":"1689916307803"} 2023-07-21 05:11:47,804 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 05:11:47,808 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:11:47,809 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:11:47,809 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:11:47,809 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:11:47,809 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:11:47,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95d31255826d43ad9ab40bdc41fba199, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a516a88a0b508abf63a58a07e82ccadb, ASSIGN}] 2023-07-21 05:11:47,812 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a516a88a0b508abf63a58a07e82ccadb, ASSIGN 2023-07-21 05:11:47,813 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95d31255826d43ad9ab40bdc41fba199, ASSIGN 2023-07-21 05:11:47,814 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a516a88a0b508abf63a58a07e82ccadb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46441,1689916199266; forceNewPlan=false, retain=false 2023-07-21 05:11:47,814 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95d31255826d43ad9ab40bdc41fba199, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36249,1689916199318; forceNewPlan=false, retain=false 2023-07-21 05:11:47,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 05:11:47,964 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:11:47,967 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a516a88a0b508abf63a58a07e82ccadb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:47,968 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916307967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916307967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916307967"}]},"ts":"1689916307967"} 2023-07-21 05:11:47,968 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=95d31255826d43ad9ab40bdc41fba199, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:47,968 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916307968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916307968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916307968"}]},"ts":"1689916307968"} 2023-07-21 05:11:47,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure a516a88a0b508abf63a58a07e82ccadb, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:11:47,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 95d31255826d43ad9ab40bdc41fba199, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:11:48,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 05:11:48,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:48,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a516a88a0b508abf63a58a07e82ccadb, NAME => 'testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:11:48,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. service=AccessControlService 2023-07-21 05:11:48,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:48,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:48,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:48,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:48,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:48,132 INFO [StoreOpener-a516a88a0b508abf63a58a07e82ccadb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:48,133 DEBUG [StoreOpener-a516a88a0b508abf63a58a07e82ccadb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf 2023-07-21 05:11:48,133 DEBUG [StoreOpener-a516a88a0b508abf63a58a07e82ccadb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf 2023-07-21 05:11:48,134 INFO [StoreOpener-a516a88a0b508abf63a58a07e82ccadb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a516a88a0b508abf63a58a07e82ccadb columnFamilyName cf 2023-07-21 05:11:48,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:48,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 95d31255826d43ad9ab40bdc41fba199, NAME => 'testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:11:48,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. service=AccessControlService 2023-07-21 05:11:48,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:48,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:48,137 INFO [StoreOpener-95d31255826d43ad9ab40bdc41fba199-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:48,139 DEBUG [StoreOpener-95d31255826d43ad9ab40bdc41fba199-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf 2023-07-21 05:11:48,139 DEBUG [StoreOpener-95d31255826d43ad9ab40bdc41fba199-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf 2023-07-21 05:11:48,139 INFO [StoreOpener-95d31255826d43ad9ab40bdc41fba199-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95d31255826d43ad9ab40bdc41fba199 columnFamilyName cf 2023-07-21 05:11:48,140 INFO [StoreOpener-95d31255826d43ad9ab40bdc41fba199-1] regionserver.HStore(310): Store=95d31255826d43ad9ab40bdc41fba199/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:48,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:48,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:48,141 INFO [StoreOpener-a516a88a0b508abf63a58a07e82ccadb-1] regionserver.HStore(310): Store=a516a88a0b508abf63a58a07e82ccadb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:48,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:11:48,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:11:48,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:48,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:48,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 95d31255826d43ad9ab40bdc41fba199; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65561649, jitterRate=-0.023055300116539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:48,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 95d31255826d43ad9ab40bdc41fba199: 2023-07-21 05:11:48,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a516a88a0b508abf63a58a07e82ccadb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72845061, jitterRate=0.08547599613666534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:48,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a516a88a0b508abf63a58a07e82ccadb: 2023-07-21 05:11:48,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb., pid=93, masterSystemTime=1689916308125 2023-07-21 05:11:48,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199., pid=94, masterSystemTime=1689916308129 2023-07-21 05:11:48,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:48,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:48,156 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a516a88a0b508abf63a58a07e82ccadb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:48,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:48,156 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916308156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916308156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916308156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916308156"}]},"ts":"1689916308156"} 2023-07-21 05:11:48,159 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=95d31255826d43ad9ab40bdc41fba199, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,159 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916308159"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916308159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916308159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916308159"}]},"ts":"1689916308159"} 2023-07-21 05:11:48,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-21 05:11:48,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure a516a88a0b508abf63a58a07e82ccadb, server=jenkins-hbase4.apache.org,46441,1689916199266 in 186 msec 2023-07-21 05:11:48,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a516a88a0b508abf63a58a07e82ccadb, ASSIGN in 352 msec 2023-07-21 05:11:48,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-21 05:11:48,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 95d31255826d43ad9ab40bdc41fba199, server=jenkins-hbase4.apache.org,36249,1689916199318 in 187 msec 2023-07-21 05:11:48,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-21 05:11:48,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95d31255826d43ad9ab40bdc41fba199, ASSIGN in 354 msec 2023-07-21 05:11:48,166 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:11:48,166 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916308166"}]},"ts":"1689916308166"} 2023-07-21 05:11:48,168 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 05:11:48,171 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:11:48,172 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-21 05:11:48,175 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:11:48,177 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:48,177 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:48,177 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:48,177 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:48,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:48,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:48,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:48,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:48,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 471 msec 2023-07-21 05:11:48,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 05:11:48,323 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-21 05:11:48,323 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-21 05:11:48,324 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:48,329 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-21 05:11:48,330 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:48,330 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-21 05:11:48,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:48,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916308333 (current time:1689916308333). 2023-07-21 05:11:48,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:48,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x15b80e1b to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:48,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e74fefa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:48,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:48,373 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:48,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15b80e1b to 127.0.0.1:53187 2023-07-21 05:11:48,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:48,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x4f3e4807 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:48,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aa34f2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:48,399 DEBUG [hconnection-0x2319f1ad-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:48,403 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:48,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:48,409 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:48,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f3e4807 to 127.0.0.1:53187 2023-07-21 05:11:48,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:48,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:11:48,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:48,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:48,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:48,414 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:48,419 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689916908419 2023-07-21 05:11:48,419 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:48,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:48,420 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:48,420 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:48,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:48,421 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:48,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-21 05:11:48,426 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:48,426 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689916908426 2023-07-21 05:11:48,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,436 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-21 05:11:48,436 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:48,441 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 05:11:48,441 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 05:11:48,442 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,442 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,450 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,450 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,450 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,450 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,451 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,451 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,451 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,451 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:48,454 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:48,454 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:48,454 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:48,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,455 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:48,455 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:48,455 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:48,454 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:48,456 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:48,456 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:48,458 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,458 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,458 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,459 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,459 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,459 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,459 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:48,459 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:48,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,459 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,460 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,460 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 05:11:48,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3444192b[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 05:11:48,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3444192b[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:48,472 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 05:11:48,472 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,474 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,474 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,474 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:48,475 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:48,475 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:11:48,475 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. started... 2023-07-21 05:11:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:48,476 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,476 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:48,477 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:48,477 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:48,477 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:48,480 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:48,480 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. started... 2023-07-21 05:11:48,490 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 95d31255826d43ad9ab40bdc41fba199: 2023-07-21 05:11:48,490 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a516a88a0b508abf63a58a07e82ccadb: 2023-07-21 05:11:48,491 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,491 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,491 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:48,491 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:48,491 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:48,491 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:48,513 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. completed. 2023-07-21 05:11:48,513 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:48,513 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:48,513 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:48,513 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,513 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:48,513 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:11:48,514 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. completed. 2023-07-21 05:11:48,514 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:48,514 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:48,514 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:48,514 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,514 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:48,514 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:11:48,515 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,515 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,515 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:48,515 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:48,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,518 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,518 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:48,518 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:48,518 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:48,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,520 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:48,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:48,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:48,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,522 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:48,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:11:48,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 05:11:48,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46441,1689916199266': 2023-07-21 05:11:48,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 05:11:48,528 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 05:11:48,528 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:48,528 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:48,528 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,528 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:48,531 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,531 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,531 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,531 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,531 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,531 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,531 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,532 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,533 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,534 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,536 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,536 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,538 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,541 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,541 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,541 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,541 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,541 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,541 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,541 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,541 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,541 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:48,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,542 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,542 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,542 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,544 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 05:11:48,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,651 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689916308419Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689916308542 (+123 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689916308542Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689916308548 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689916308557 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689916308651 (+94 ms) 2023-07-21 05:11:48,656 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:48,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 236 msec 2023-07-21 05:11:48,722 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:48,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:48,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:48,738 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46441] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:48,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36249] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:48,746 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:48,746 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:48,746 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:48,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:48,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916308759 (current time:1689916308759). 2023-07-21 05:11:48,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:48,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x4b2a07ec to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:48,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27d213bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:48,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:48,773 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:48,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b2a07ec to 127.0.0.1:53187 2023-07-21 05:11:48,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:48,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x02b1c0ac to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:48,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@193fa271, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:48,783 DEBUG [hconnection-0x2e471510-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:48,784 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:48,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:48,789 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:48,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02b1c0ac to 127.0.0.1:53187 2023-07-21 05:11:48,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:48,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:11:48,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:48,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:48,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:48,795 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:48,795 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689916908795 2023-07-21 05:11:48,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:48,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:48,797 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:48,797 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:48,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:48,798 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:48,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-21 05:11:48,800 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:48,801 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689916908801 2023-07-21 05:11:48,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,812 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-21 05:11:48,812 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:48,814 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 05:11:48,814 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 05:11:48,814 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,814 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,815 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,815 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,815 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,815 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,816 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,816 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,816 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,816 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:48,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,817 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,817 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:48,818 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:48,818 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:48,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,819 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:48,819 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:48,819 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:48,819 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:48,820 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:48,820 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:48,820 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:48,818 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:48,820 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:48,827 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:48,827 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:48,827 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:48,828 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,828 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,828 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,830 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,831 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,831 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,831 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 05:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b8d6a9a[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 05:11:48,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b8d6a9a[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:48,836 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 05:11:48,836 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:48,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,840 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:48,840 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:48,840 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,840 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:48,840 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:48,840 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:48,841 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:48,841 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. started... 2023-07-21 05:11:48,841 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. started... 2023-07-21 05:11:48,841 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,841 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:48,841 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 95d31255826d43ad9ab40bdc41fba199 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-21 05:11:48,841 INFO [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a516a88a0b508abf63a58a07e82ccadb 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-21 05:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:11:48,843 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:48,843 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:48,843 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:48,855 INFO [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/.tmp/cf/a3e14d2a59d74906ac606dd90b66d174 2023-07-21 05:11:48,855 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/.tmp/cf/022c08919f804db395a1ae70576c6557 2023-07-21 05:11:48,860 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/.tmp/cf/a3e14d2a59d74906ac606dd90b66d174 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf/a3e14d2a59d74906ac606dd90b66d174 2023-07-21 05:11:48,861 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/.tmp/cf/022c08919f804db395a1ae70576c6557 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf/022c08919f804db395a1ae70576c6557 2023-07-21 05:11:48,866 INFO [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf/a3e14d2a59d74906ac606dd90b66d174, entries=47, sequenceid=6, filesize=8.0 K 2023-07-21 05:11:48,867 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf/022c08919f804db395a1ae70576c6557, entries=3, sequenceid=6, filesize=5.0 K 2023-07-21 05:11:48,867 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 95d31255826d43ad9ab40bdc41fba199 in 26ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:48,867 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-21 05:11:48,868 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 95d31255826d43ad9ab40bdc41fba199: 2023-07-21 05:11:48,868 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,868 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:48,868 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf/022c08919f804db395a1ae70576c6557] hfiles 2023-07-21 05:11:48,868 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf/022c08919f804db395a1ae70576c6557 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,875 INFO [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a516a88a0b508abf63a58a07e82ccadb in 34ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:48,877 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a516a88a0b508abf63a58a07e82ccadb: 2023-07-21 05:11:48,878 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,879 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:48,879 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf/a3e14d2a59d74906ac606dd90b66d174] hfiles 2023-07-21 05:11:48,879 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf/a3e14d2a59d74906ac606dd90b66d174 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,881 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. completed. 2023-07-21 05:11:48,881 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:11:48,881 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:48,881 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:48,881 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,881 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:48,881 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:11:48,883 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:48,883 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,883 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:48,883 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:11:48,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 05:11:48,889 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. completed. 2023-07-21 05:11:48,889 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:11:48,889 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:48,889 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:48,889 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,889 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:48,889 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:11:48,891 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,891 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:48,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,891 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:48,891 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:48,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46441,1689916199266': 2023-07-21 05:11:48,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 05:11:48,895 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 05:11:48,895 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:48,895 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:48,895 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,895 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:48,897 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:48,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:48,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:48,898 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,898 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,898 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,898 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,899 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,899 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,899 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:48,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:48,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:48,898 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,900 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,900 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,901 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:48,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:48,902 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,903 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,903 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,906 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,906 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,906 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,906 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:48,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,906 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,906 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,906 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,906 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:48,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:48,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:48,906 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,907 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,906 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:48,907 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,907 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,908 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:11:48,908 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,908 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:11:48,909 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:11:48,909 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,909 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:48,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 05:11:48,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,946 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:48,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689916308795Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689916308906 (+111 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689916308906Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689916308913 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689916308920 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689916308945 (+25 ms) 2023-07-21 05:11:48,949 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:48,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 153 msec 2023-07-21 05:11:49,099 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:49,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:49,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:49,101 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101 2023-07-21 05:11:49,101 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36811, tgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101, rawTgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101, srcFsUri=hdfs://localhost:36811, srcDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:11:49,127 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:11:49,127 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1308086348_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:49,127 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab, snapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-21 05:11:49,134 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:49,208 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:49,208 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,349 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-864817263834234495.jar 2023-07-21 05:11:50,349 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,350 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,430 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-4751099842336324867.jar 2023-07-21 05:11:50,431 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,431 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,432 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,432 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,433 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,433 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:50,434 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:11:50,434 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:11:50,434 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:11:50,435 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:11:50,435 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:11:50,436 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:11:50,436 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:11:50,436 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:11:50,437 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:11:50,438 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:11:50,438 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:50,439 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:50,439 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:50,440 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:50,440 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:50,441 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:50,441 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:51,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:51,279 WARN [Listener at jenkins-hbase4.apache.org/37521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:11:51,283 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-21 05:11:51,408 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:51,408 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:52,035 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0006_000001 (auth:SIMPLE) 2023-07-21 05:11:52,589 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:11:57,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0006_000001 (auth:SIMPLE) 2023-07-21 05:12:00,721 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:12:00,723 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:12:00,731 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:12:00,731 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:12:00,733 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:12:00,734 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:12:00,734 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 05:12:00,734 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 05:12:00,734 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:12:00,735 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 05:12:00,735 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916309101/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 05:12:00,743 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-21 05:12:00,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-21 05:12:00,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:12:00,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 05:12:00,748 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916320748"}]},"ts":"1689916320748"} 2023-07-21 05:12:00,750 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 05:12:00,752 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-21 05:12:00,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95d31255826d43ad9ab40bdc41fba199, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a516a88a0b508abf63a58a07e82ccadb, UNASSIGN}] 2023-07-21 05:12:00,758 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95d31255826d43ad9ab40bdc41fba199, UNASSIGN 2023-07-21 05:12:00,758 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a516a88a0b508abf63a58a07e82ccadb, UNASSIGN 2023-07-21 05:12:00,760 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a516a88a0b508abf63a58a07e82ccadb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:00,760 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=95d31255826d43ad9ab40bdc41fba199, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:00,760 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916320760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916320760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916320760"}]},"ts":"1689916320760"} 2023-07-21 05:12:00,760 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916320760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916320760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916320760"}]},"ts":"1689916320760"} 2023-07-21 05:12:00,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure a516a88a0b508abf63a58a07e82ccadb, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:12:00,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 95d31255826d43ad9ab40bdc41fba199, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:12:00,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 05:12:00,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:12:00,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a516a88a0b508abf63a58a07e82ccadb, disabling compactions & flushes 2023-07-21 05:12:00,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:12:00,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:12:00,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. after waiting 0 ms 2023-07-21 05:12:00,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:12:00,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:12:00,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 95d31255826d43ad9ab40bdc41fba199, disabling compactions & flushes 2023-07-21 05:12:00,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:12:00,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:12:00,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. after waiting 0 ms 2023-07-21 05:12:00,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:12:00,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:12:00,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:12:00,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:00,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:00,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb. 2023-07-21 05:12:00,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199. 2023-07-21 05:12:00,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a516a88a0b508abf63a58a07e82ccadb: 2023-07-21 05:12:00,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 95d31255826d43ad9ab40bdc41fba199: 2023-07-21 05:12:00,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:12:00,978 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a516a88a0b508abf63a58a07e82ccadb, regionState=CLOSED 2023-07-21 05:12:00,978 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916320978"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916320978"}]},"ts":"1689916320978"} 2023-07-21 05:12:00,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:12:00,981 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=95d31255826d43ad9ab40bdc41fba199, regionState=CLOSED 2023-07-21 05:12:00,981 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916320981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916320981"}]},"ts":"1689916320981"} 2023-07-21 05:12:00,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-21 05:12:00,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure a516a88a0b508abf63a58a07e82ccadb, server=jenkins-hbase4.apache.org,46441,1689916199266 in 219 msec 2023-07-21 05:12:00,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a516a88a0b508abf63a58a07e82ccadb, UNASSIGN in 232 msec 2023-07-21 05:12:00,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-21 05:12:00,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 95d31255826d43ad9ab40bdc41fba199, server=jenkins-hbase4.apache.org,36249,1689916199318 in 218 msec 2023-07-21 05:12:00,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-21 05:12:00,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95d31255826d43ad9ab40bdc41fba199, UNASSIGN in 234 msec 2023-07-21 05:12:00,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916320990"}]},"ts":"1689916320990"} 2023-07-21 05:12:00,992 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 05:12:00,994 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-21 05:12:00,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 251 msec 2023-07-21 05:12:01,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 05:12:01,051 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-21 05:12:01,052 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,055 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,056 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,059 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,061 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:12:01,061 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:12:01,062 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,062 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,062 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,062 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 05:12:01,064 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/recovered.edits] 2023-07-21 05:12:01,064 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/recovered.edits] 2023-07-21 05:12:01,067 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 05:12:01,067 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,067 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,067 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:01,067 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:01,067 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,067 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:01,067 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 05:12:01,067 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 05:12:01,067 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,067 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:01,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 05:12:01,071 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf/a3e14d2a59d74906ac606dd90b66d174 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/cf/a3e14d2a59d74906ac606dd90b66d174 2023-07-21 05:12:01,072 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf/022c08919f804db395a1ae70576c6557 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/cf/022c08919f804db395a1ae70576c6557 2023-07-21 05:12:01,079 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199/recovered.edits/9.seqid 2023-07-21 05:12:01,080 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb/recovered.edits/9.seqid 2023-07-21 05:12:01,080 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/95d31255826d43ad9ab40bdc41fba199 2023-07-21 05:12:01,080 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testEmptyExportFileSystemState/a516a88a0b508abf63a58a07e82ccadb 2023-07-21 05:12:01,080 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 05:12:01,084 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,086 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-21 05:12:01,088 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-21 05:12:01,089 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,089 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-21 05:12:01,089 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916321089"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:01,089 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916321089"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:01,091 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:12:01,091 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 95d31255826d43ad9ab40bdc41fba199, NAME => 'testtb-testEmptyExportFileSystemState,,1689916307708.95d31255826d43ad9ab40bdc41fba199.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a516a88a0b508abf63a58a07e82ccadb, NAME => 'testtb-testEmptyExportFileSystemState,1,1689916307708.a516a88a0b508abf63a58a07e82ccadb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:12:01,091 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-21 05:12:01,091 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916321091"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:01,093 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-21 05:12:01,095 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:12:01,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 43 msec 2023-07-21 05:12:01,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 05:12:01,169 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-21 05:12:01,178 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-21 05:12:01,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:12:01,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-21 05:12:01,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-21 05:12:01,221 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 760) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:39723 from appattempt_1689916208390_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:42772 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:50822 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:46253 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1263363530_1 at /127.0.0.1:51422 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135645938_17 at /127.0.0.1:51200 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1263363530_1 at /127.0.0.1:50172 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x520f41b4-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4488 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=920 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=657 (was 710), ProcessCount=185 (was 185), AvailableMemoryMB=2001 (was 1769) - AvailableMemoryMB LEAK? - 2023-07-21 05:12:01,221 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-21 05:12:01,253 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=657, ProcessCount=185, AvailableMemoryMB=2000 2023-07-21 05:12:01,253 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-21 05:12:01,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:12:01,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:01,259 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:12:01,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-21 05:12:01,260 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:12:01,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 05:12:01,262 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,262 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,263 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee empty. 2023-07-21 05:12:01,263 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544 empty. 2023-07-21 05:12:01,263 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,263 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,263 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 05:12:01,287 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-21 05:12:01,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5cde0506d41479dc1525e4db43c09ee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:12:01,290 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0ff75c7f34e257e81d4d3585f07d0544, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp 2023-07-21 05:12:01,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:12:01,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 0ff75c7f34e257e81d4d3585f07d0544, disabling compactions & flushes 2023-07-21 05:12:01,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:01,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:01,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. after waiting 0 ms 2023-07-21 05:12:01,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:01,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:01,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 0ff75c7f34e257e81d4d3585f07d0544: 2023-07-21 05:12:01,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 05:12:01,363 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:12:01,364 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing b5cde0506d41479dc1525e4db43c09ee, disabling compactions & flushes 2023-07-21 05:12:01,364 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:01,364 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:01,364 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. after waiting 0 ms 2023-07-21 05:12:01,364 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:01,364 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:01,364 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for b5cde0506d41479dc1525e4db43c09ee: 2023-07-21 05:12:01,368 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:12:01,369 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916321369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916321369"}]},"ts":"1689916321369"} 2023-07-21 05:12:01,369 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916321369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916321369"}]},"ts":"1689916321369"} 2023-07-21 05:12:01,378 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:12:01,380 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:12:01,380 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916321380"}]},"ts":"1689916321380"} 2023-07-21 05:12:01,382 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-21 05:12:01,386 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:12:01,388 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:12:01,388 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:12:01,388 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:12:01,388 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:12:01,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b5cde0506d41479dc1525e4db43c09ee, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0ff75c7f34e257e81d4d3585f07d0544, ASSIGN}] 2023-07-21 05:12:01,392 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b5cde0506d41479dc1525e4db43c09ee, ASSIGN 2023-07-21 05:12:01,392 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0ff75c7f34e257e81d4d3585f07d0544, ASSIGN 2023-07-21 05:12:01,394 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b5cde0506d41479dc1525e4db43c09ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36249,1689916199318; forceNewPlan=false, retain=false 2023-07-21 05:12:01,394 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0ff75c7f34e257e81d4d3585f07d0544, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46441,1689916199266; forceNewPlan=false, retain=false 2023-07-21 05:12:01,544 INFO [jenkins-hbase4:38519] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:12:01,547 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0ff75c7f34e257e81d4d3585f07d0544, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:01,548 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916321547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916321547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916321547"}]},"ts":"1689916321547"} 2023-07-21 05:12:01,548 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b5cde0506d41479dc1525e4db43c09ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:01,548 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916321548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916321548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916321548"}]},"ts":"1689916321548"} 2023-07-21 05:12:01,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 0ff75c7f34e257e81d4d3585f07d0544, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:12:01,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure b5cde0506d41479dc1525e4db43c09ee, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:12:01,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 05:12:01,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:01,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5cde0506d41479dc1525e4db43c09ee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:12:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ff75c7f34e257e81d4d3585f07d0544, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:12:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. service=AccessControlService 2023-07-21 05:12:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. service=AccessControlService 2023-07-21 05:12:01,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:12:01,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:12:01,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:12:01,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:12:01,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,711 INFO [StoreOpener-0ff75c7f34e257e81d4d3585f07d0544-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,712 INFO [StoreOpener-b5cde0506d41479dc1525e4db43c09ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,712 DEBUG [StoreOpener-0ff75c7f34e257e81d4d3585f07d0544-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf 2023-07-21 05:12:01,712 DEBUG [StoreOpener-0ff75c7f34e257e81d4d3585f07d0544-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf 2023-07-21 05:12:01,713 INFO [StoreOpener-0ff75c7f34e257e81d4d3585f07d0544-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ff75c7f34e257e81d4d3585f07d0544 columnFamilyName cf 2023-07-21 05:12:01,714 DEBUG [StoreOpener-b5cde0506d41479dc1525e4db43c09ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf 2023-07-21 05:12:01,714 INFO [StoreOpener-0ff75c7f34e257e81d4d3585f07d0544-1] regionserver.HStore(310): Store=0ff75c7f34e257e81d4d3585f07d0544/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:12:01,714 DEBUG [StoreOpener-b5cde0506d41479dc1525e4db43c09ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf 2023-07-21 05:12:01,714 INFO [StoreOpener-b5cde0506d41479dc1525e4db43c09ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5cde0506d41479dc1525e4db43c09ee columnFamilyName cf 2023-07-21 05:12:01,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,715 INFO [StoreOpener-b5cde0506d41479dc1525e4db43c09ee-1] regionserver.HStore(310): Store=b5cde0506d41479dc1525e4db43c09ee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:12:01,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:01,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:01,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:12:01,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:12:01,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ff75c7f34e257e81d4d3585f07d0544; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68328413, jitterRate=0.018172696232795715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:12:01,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5cde0506d41479dc1525e4db43c09ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63079563, jitterRate=-0.060041263699531555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:12:01,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ff75c7f34e257e81d4d3585f07d0544: 2023-07-21 05:12:01,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5cde0506d41479dc1525e4db43c09ee: 2023-07-21 05:12:01,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544., pid=108, masterSystemTime=1689916321703 2023-07-21 05:12:01,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee., pid=109, masterSystemTime=1689916321703 2023-07-21 05:12:01,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:01,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:01,727 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b5cde0506d41479dc1525e4db43c09ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:01,728 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916321727"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916321727"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916321727"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916321727"}]},"ts":"1689916321727"} 2023-07-21 05:12:01,728 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0ff75c7f34e257e81d4d3585f07d0544, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:01,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:01,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:01,728 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916321728"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916321728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916321728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916321728"}]},"ts":"1689916321728"} 2023-07-21 05:12:01,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-21 05:12:01,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure b5cde0506d41479dc1525e4db43c09ee, server=jenkins-hbase4.apache.org,36249,1689916199318 in 179 msec 2023-07-21 05:12:01,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-21 05:12:01,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 0ff75c7f34e257e81d4d3585f07d0544, server=jenkins-hbase4.apache.org,46441,1689916199266 in 180 msec 2023-07-21 05:12:01,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b5cde0506d41479dc1525e4db43c09ee, ASSIGN in 345 msec 2023-07-21 05:12:01,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-21 05:12:01,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0ff75c7f34e257e81d4d3585f07d0544, ASSIGN in 346 msec 2023-07-21 05:12:01,736 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:12:01,737 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916321737"}]},"ts":"1689916321737"} 2023-07-21 05:12:01,738 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-21 05:12:01,740 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:12:01,741 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-21 05:12:01,742 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 05:12:01,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:01,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:01,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:01,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:01,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 05:12:01,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 05:12:01,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 05:12:01,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 05:12:01,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 490 msec 2023-07-21 05:12:01,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 05:12:01,865 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-21 05:12:01,865 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-21 05:12:01,866 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:12:01,869 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-21 05:12:01,870 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:12:01,870 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-21 05:12:01,873 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:12:01,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916321873 (current time:1689916321873). 2023-07-21 05:12:01,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:12:01,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x2290cf7f to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:12:01,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41f85788, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:12:01,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:12:01,921 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:12:01,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2290cf7f to 127.0.0.1:53187 2023-07-21 05:12:01,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:01,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x43319f45 to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:12:01,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@677e5b6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:12:01,946 DEBUG [hconnection-0x6439041b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:12:01,954 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:12:01,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:12:01,963 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:12:01,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43319f45 to 127.0.0.1:53187 2023-07-21 05:12:01,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:01,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 05:12:01,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:12:01,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:12:01,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:12:01,971 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:12:01,972 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689916921972 2023-07-21 05:12:01,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:12:01,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:01,972 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:12:01,973 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:12:01,976 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:12:01,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:12:01,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-21 05:12:01,981 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:12:01,983 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689916921983 2023-07-21 05:12:02,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,052 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 05:12:02,053 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:12:02,054 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 05:12:02,054 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 05:12:02,069 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,069 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,072 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,072 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,072 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,073 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:12:02,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 05:12:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,074 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:12:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:12:02,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:12:02,074 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:12:02,072 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,078 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,079 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 05:12:02,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:12:02,079 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,079 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:12:02,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 05:12:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:12:02,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,082 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:12:02,082 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:12:02,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,087 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:12:02,087 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:12:02,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,105 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:12:02,106 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:12:02,107 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:12:02,107 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:12:02,107 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:12:02,108 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:12:02,108 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:12:02,108 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:12:02,108 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:12:02,108 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:12:02,108 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:12:02,114 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,114 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,115 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,115 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,114 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,115 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:12:02,115 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,116 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,116 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:12:02,116 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,116 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:12:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 05:12:02,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ee8dbbc[Count = 1] remaining members to acquire global barrier 2023-07-21 05:12:02,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 05:12:02,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ee8dbbc[Count = 0] remaining members to acquire global barrier 2023-07-21 05:12:02,123 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 05:12:02,123 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,124 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,124 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,124 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:12:02,125 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:12:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:12:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:12:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:12:02,125 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,125 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:12:02,128 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:12:02,128 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:12:02,128 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:12:02,133 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:12:02,133 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:12:02,133 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:12:02,133 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:12:02,133 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:02,134 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. started... 2023-07-21 05:12:02,141 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0ff75c7f34e257e81d4d3585f07d0544: 2023-07-21 05:12:02,141 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,141 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:12:02,141 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:12:02,142 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:02,142 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. started... 2023-07-21 05:12:02,143 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5cde0506d41479dc1525e4db43c09ee: 2023-07-21 05:12:02,144 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,144 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:12:02,144 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:12:02,182 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. completed. 2023-07-21 05:12:02,182 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:02,182 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:12:02,182 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:12:02,182 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,182 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:12:02,182 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:12:02,184 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,184 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:12:02,184 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. completed. 2023-07-21 05:12:02,184 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:12:02,184 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:02,184 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:12:02,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,186 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:12:02,186 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:12:02,186 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,186 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:12:02,186 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:12:02,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,188 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:12:02,188 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:12:02,188 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,188 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:12:02,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:12:02,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 05:12:02,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46441,1689916199266': 2023-07-21 05:12:02,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 05:12:02,219 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 05:12:02,219 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:12:02,219 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:12:02,219 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,219 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:12:02,221 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,221 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,222 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,221 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,221 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,222 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,222 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,222 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,226 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,227 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,228 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,229 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,229 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,233 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,233 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,233 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:12:02,233 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,233 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,233 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,233 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,235 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,233 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,235 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,236 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,236 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,236 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,236 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,236 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,237 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,237 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,237 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,275 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:12:02,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:12:02,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:12:02,276 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:12:02,315 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 05:12:02,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,316 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689916321972Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689916322233 (+261 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689916322236 (+3 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689916322239 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689916322252 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689916322315 (+63 ms) 2023-07-21 05:12:02,320 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:12:02,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 346 msec 2023-07-21 05:12:02,576 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:12:02,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:12:02,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:12:02,593 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46441] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:12:02,607 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36249] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:12:02,612 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,612 DEBUG [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:02,612 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:12:02,630 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:12:02,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916322630 (current time:1689916322630). 2023-07-21 05:12:02,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:12:02,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x55c060fb to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:12:02,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7975bf84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:12:02,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:12:02,641 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:12:02,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55c060fb to 127.0.0.1:53187 2023-07-21 05:12:02,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:02,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(139): Connect 0x15755b4d to 127.0.0.1:53187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:12:02,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@436426a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:12:02,659 DEBUG [hconnection-0x173928d7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:12:02,663 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:12:02,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:12:02,679 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:12:02,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15755b4d to 127.0.0.1:53187 2023-07-21 05:12:02,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:02,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 05:12:02,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:12:02,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:12:02,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:12:02,687 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:12:02,688 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689916922688 2023-07-21 05:12:02,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:12:02,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,690 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:12:02,690 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:12:02,692 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:12:02,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:12:02,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-21 05:12:02,694 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:12:02,694 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689916922694 2023-07-21 05:12:02,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,720 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 05:12:02,721 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:12:02,722 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 05:12:02,722 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 05:12:02,723 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,723 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,724 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,725 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,725 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,724 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,725 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,725 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,726 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,726 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:12:02,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,727 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:12:02,727 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:12:02,727 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:12:02,728 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:12:02,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 05:12:02,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:12:02,730 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:12:02,730 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:12:02,730 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:12:02,728 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:12:02,730 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:12:02,730 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:12:02,733 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,733 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,733 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,733 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,734 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,734 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:12:02,734 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,734 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:12:02,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46441,1689916199266' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 05:12:02,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5a3358[Count = 1] remaining members to acquire global barrier 2023-07-21 05:12:02,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36249,1689916199318' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 05:12:02,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5a3358[Count = 0] remaining members to acquire global barrier 2023-07-21 05:12:02,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,738 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 05:12:02,739 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,739 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:12:02,739 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:12:02,740 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:12:02,740 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:12:02,740 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39445,1689916199184' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:12:02,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,744 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:12:02,744 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,744 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:12:02,745 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:12:02,745 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:12:02,746 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:02,749 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:12:02,749 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:12:02,749 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. started... 2023-07-21 05:12:02,749 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:02,749 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. started... 2023-07-21 05:12:02,749 INFO [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0ff75c7f34e257e81d4d3585f07d0544 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-21 05:12:02,749 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b5cde0506d41479dc1525e4db43c09ee 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-21 05:12:02,751 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,756 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,756 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:12:02,759 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,759 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,759 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,759 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:12:02,759 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:12:02,759 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:12:02,760 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39445,1689916199184' in zk 2023-07-21 05:12:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:12:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:12:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,39445,1689916199184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:12:02,790 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:12:02,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:12:02,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:12:02,792 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:12:02,806 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/.tmp/cf/41cebede520f43ef82db10779958d772 2023-07-21 05:12:02,806 INFO [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/.tmp/cf/4cb6c3f674b04c948904d266a99815aa 2023-07-21 05:12:02,812 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/.tmp/cf/4cb6c3f674b04c948904d266a99815aa as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf/4cb6c3f674b04c948904d266a99815aa 2023-07-21 05:12:02,813 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/.tmp/cf/41cebede520f43ef82db10779958d772 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf/41cebede520f43ef82db10779958d772 2023-07-21 05:12:02,817 INFO [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf/4cb6c3f674b04c948904d266a99815aa, entries=47, sequenceid=6, filesize=8.0 K 2023-07-21 05:12:02,818 INFO [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0ff75c7f34e257e81d4d3585f07d0544 in 69ms, sequenceid=6, compaction requested=false 2023-07-21 05:12:02,818 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-21 05:12:02,819 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0ff75c7f34e257e81d4d3585f07d0544: 2023-07-21 05:12:02,819 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,819 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:12:02,819 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf/4cb6c3f674b04c948904d266a99815aa] hfiles 2023-07-21 05:12:02,819 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf/4cb6c3f674b04c948904d266a99815aa for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,823 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf/41cebede520f43ef82db10779958d772, entries=3, sequenceid=6, filesize=5.0 K 2023-07-21 05:12:02,824 INFO [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b5cde0506d41479dc1525e4db43c09ee in 75ms, sequenceid=6, compaction requested=false 2023-07-21 05:12:02,836 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5cde0506d41479dc1525e4db43c09ee: 2023-07-21 05:12:02,837 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,837 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:12:02,837 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf/41cebede520f43ef82db10779958d772] hfiles 2023-07-21 05:12:02,837 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf/41cebede520f43ef82db10779958d772 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,851 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. completed. 2023-07-21 05:12:02,851 DEBUG [rs(jenkins-hbase4.apache.org,36249,1689916199318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:02,851 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:12:02,851 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:12:02,851 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,851 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:12:02,851 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36249,1689916199318' in zk 2023-07-21 05:12:02,853 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:12:02,853 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,853 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:12:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,853 DEBUG [member: 'jenkins-hbase4.apache.org,36249,1689916199318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:12:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36249,1689916199318': 2023-07-21 05:12:02,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36249,1689916199318' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 05:12:02,867 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. completed. 2023-07-21 05:12:02,867 DEBUG [rs(jenkins-hbase4.apache.org,46441,1689916199266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46441,1689916199266' in zk 2023-07-21 05:12:02,869 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,870 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:12:02,870 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:12:02,870 DEBUG [member: 'jenkins-hbase4.apache.org,46441,1689916199266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:12:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46441,1689916199266': 2023-07-21 05:12:02,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46441,1689916199266' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 05:12:02,875 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 05:12:02,875 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:12:02,875 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:12:02,875 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,875 INFO [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:12:02,877 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,877 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,877 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,877 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,877 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,877 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,878 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:12:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,878 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,878 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:12:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,879 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:12:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,882 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,882 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,883 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,887 DEBUG [(jenkins-hbase4.apache.org,38519,1689916197810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:12:02,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:12:02,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,889 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:12:02,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,887 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,887 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:02,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,890 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:02,890 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,890 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:12:02,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:12:02,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 05:12:02,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,952 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:02,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689916322689Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689916322890 (+201 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689916322890Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689916322894 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689916322904 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689916322951 (+47 ms) 2023-07-21 05:12:02,956 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:12:02,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 266 msec 2023-07-21 05:12:02,992 DEBUG [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:12:02,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:12:02,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:12:02,994 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994 2023-07-21 05:12:02,994 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36811, tgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994, rawTgtDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994, srcFsUri=hdfs://localhost:36811, srcDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:12:03,027 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab 2023-07-21 05:12:03,029 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_790429408_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:03,029 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36811, inputRoot=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab, snapshotDir=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-21 05:12:03,050 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:03,087 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:03,088 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:03,088 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:03,088 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,301 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-3926559041514057683.jar 2023-07-21 05:12:04,302 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,302 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,393 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/hadoop-8492767857778729317.jar 2023-07-21 05:12:04,393 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,394 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,395 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,395 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,396 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,396 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:12:04,397 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:12:04,397 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:12:04,398 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:12:04,398 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:12:04,398 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:12:04,399 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:12:04,399 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:12:04,400 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:12:04,400 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:12:04,400 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:12:04,401 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:12:04,401 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:12:04,402 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:12:04,402 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:12:04,402 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:12:04,403 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:12:04,404 DEBUG [Listener at jenkins-hbase4.apache.org/37521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:12:05,339 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0006_000001 (auth:SIMPLE) 2023-07-21 05:12:05,913 WARN [Listener at jenkins-hbase4.apache.org/37521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:12:05,916 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-21 05:12:05,919 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 05:12:06,535 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:12:06,535 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:12:06,684 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:12:07,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0007_000001 (auth:SIMPLE) 2023-07-21 05:12:13,427 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0007_000001 (auth:SIMPLE) 2023-07-21 05:12:15,787 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0007_000001 (auth:SIMPLE) 2023-07-21 05:12:18,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208390_0007_000001 (auth:SIMPLE) 2023-07-21 05:12:19,767 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:12:19,767 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:12:19,780 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:19,781 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:12:19,781 INFO [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:12:19,781 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:19,782 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 05:12:19,782 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 05:12:19,782 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2135645938_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:19,782 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 05:12:19,782 DEBUG [Listener at jenkins-hbase4.apache.org/37521] snapshot.TestExportSnapshot(367): hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/export-test/export-1689916322994/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 05:12:19,788 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:19,788 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:19,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:19,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 05:12:19,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916339792"}]},"ts":"1689916339792"} 2023-07-21 05:12:19,793 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-21 05:12:19,794 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-21 05:12:19,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b5cde0506d41479dc1525e4db43c09ee, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0ff75c7f34e257e81d4d3585f07d0544, UNASSIGN}] 2023-07-21 05:12:19,795 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b5cde0506d41479dc1525e4db43c09ee, UNASSIGN 2023-07-21 05:12:19,796 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0ff75c7f34e257e81d4d3585f07d0544, UNASSIGN 2023-07-21 05:12:19,797 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=b5cde0506d41479dc1525e4db43c09ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:19,797 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0ff75c7f34e257e81d4d3585f07d0544, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:19,797 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916339797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916339797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916339797"}]},"ts":"1689916339797"} 2023-07-21 05:12:19,797 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916339797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916339797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916339797"}]},"ts":"1689916339797"} 2023-07-21 05:12:19,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure b5cde0506d41479dc1525e4db43c09ee, server=jenkins-hbase4.apache.org,36249,1689916199318}] 2023-07-21 05:12:19,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 0ff75c7f34e257e81d4d3585f07d0544, server=jenkins-hbase4.apache.org,46441,1689916199266}] 2023-07-21 05:12:19,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 05:12:19,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:19,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:19,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ff75c7f34e257e81d4d3585f07d0544, disabling compactions & flushes 2023-07-21 05:12:19,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5cde0506d41479dc1525e4db43c09ee, disabling compactions & flushes 2023-07-21 05:12:19,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:19,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:19,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:19,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:19,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. after waiting 0 ms 2023-07-21 05:12:19,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. after waiting 0 ms 2023-07-21 05:12:19,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:19,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:19,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:12:19,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:12:19,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:19,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:19,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544. 2023-07-21 05:12:19,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee. 2023-07-21 05:12:19,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ff75c7f34e257e81d4d3585f07d0544: 2023-07-21 05:12:19,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5cde0506d41479dc1525e4db43c09ee: 2023-07-21 05:12:19,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:19,966 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0ff75c7f34e257e81d4d3585f07d0544, regionState=CLOSED 2023-07-21 05:12:19,966 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916339966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916339966"}]},"ts":"1689916339966"} 2023-07-21 05:12:19,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:19,966 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=b5cde0506d41479dc1525e4db43c09ee, regionState=CLOSED 2023-07-21 05:12:19,967 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916339966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916339966"}]},"ts":"1689916339966"} 2023-07-21 05:12:19,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-21 05:12:19,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 0ff75c7f34e257e81d4d3585f07d0544, server=jenkins-hbase4.apache.org,46441,1689916199266 in 168 msec 2023-07-21 05:12:19,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-21 05:12:19,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure b5cde0506d41479dc1525e4db43c09ee, server=jenkins-hbase4.apache.org,36249,1689916199318 in 170 msec 2023-07-21 05:12:19,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0ff75c7f34e257e81d4d3585f07d0544, UNASSIGN in 174 msec 2023-07-21 05:12:19,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-21 05:12:19,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b5cde0506d41479dc1525e4db43c09ee, UNASSIGN in 175 msec 2023-07-21 05:12:19,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916339971"}]},"ts":"1689916339971"} 2023-07-21 05:12:19,972 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-21 05:12:19,974 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-21 05:12:19,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 186 msec 2023-07-21 05:12:20,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 05:12:20,094 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-21 05:12:20,094 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,097 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,098 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,099 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46441] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,102 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:20,102 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:20,103 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,103 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,103 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,103 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,103 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 05:12:20,103 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 05:12:20,103 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 05:12:20,103 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 05:12:20,104 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,104 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,104 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,105 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,105 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:20,105 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:20,105 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:20,105 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/recovered.edits] 2023-07-21 05:12:20,105 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:20,105 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf, FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/recovered.edits] 2023-07-21 05:12:20,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 05:12:20,109 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf/41cebede520f43ef82db10779958d772 to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/cf/41cebede520f43ef82db10779958d772 2023-07-21 05:12:20,109 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf/4cb6c3f674b04c948904d266a99815aa to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/cf/4cb6c3f674b04c948904d266a99815aa 2023-07-21 05:12:20,112 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee/recovered.edits/9.seqid 2023-07-21 05:12:20,112 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/recovered.edits/9.seqid to hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544/recovered.edits/9.seqid 2023-07-21 05:12:20,112 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b5cde0506d41479dc1525e4db43c09ee 2023-07-21 05:12:20,112 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0ff75c7f34e257e81d4d3585f07d0544 2023-07-21 05:12:20,112 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 05:12:20,115 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,117 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-21 05:12:20,118 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-21 05:12:20,119 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,119 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-21 05:12:20,119 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916340119"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:20,119 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916340119"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:20,121 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:12:20,121 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b5cde0506d41479dc1525e4db43c09ee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689916321255.b5cde0506d41479dc1525e4db43c09ee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0ff75c7f34e257e81d4d3585f07d0544, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916321255.0ff75c7f34e257e81d4d3585f07d0544.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:12:20,121 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-21 05:12:20,121 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916340121"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:20,122 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-21 05:12:20,124 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 30 msec 2023-07-21 05:12:20,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 05:12:20,207 INFO [Listener at jenkins-hbase4.apache.org/37521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-21 05:12:20,213 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 05:12:20,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,217 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 05:12:20,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38519] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:20,244 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 763), OpenFileDescriptor=901 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=733 (was 657) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=2394 (was 2000) - AvailableMemoryMB LEAK? - 2023-07-21 05:12:20,244 WARN [Listener at jenkins-hbase4.apache.org/37521] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-21 05:12:20,244 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-21 05:12:20,255 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 05:12:20,365 WARN [ContainersLauncher #2] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689916208390_0007_01_000001 is : 143 2023-07-21 05:12:25,532 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:12:34,382 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 05:12:48,514 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 05:12:48,515 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 05:12:48,628 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-21 05:12:48,639 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-21 05:12:48,641 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 05:12:48,682 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 05:12:48,787 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 05:12:48,787 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-21 05:12:48,788 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-21 05:12:48,788 INFO [Listener at jenkins-hbase4.apache.org/37521] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 05:12:48,788 DEBUG [Listener at jenkins-hbase4.apache.org/37521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x172f6466 to 127.0.0.1:53187 2023-07-21 05:12:48,788 DEBUG [Listener at jenkins-hbase4.apache.org/37521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:48,788 DEBUG [Listener at jenkins-hbase4.apache.org/37521] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-21 05:12:48,788 DEBUG [Listener at jenkins-hbase4.apache.org/37521] util.JVMClusterUtil(257): Found active master hash=1157648882, stopped=false 2023-07-21 05:12:48,788 DEBUG [Listener at jenkins-hbase4.apache.org/37521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:48,789 DEBUG [Listener at jenkins-hbase4.apache.org/37521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 05:12:48,789 INFO [Listener at jenkins-hbase4.apache.org/37521] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:12:48,790 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 05:12:48,790 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 05:12:48,790 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 05:12:48,790 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 05:12:48,790 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:12:48,790 INFO [Listener at jenkins-hbase4.apache.org/37521] procedure2.ProcedureExecutor(629): Stopping 2023-07-21 05:12:48,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:12:48,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:12:48,791 DEBUG [Listener at jenkins-hbase4.apache.org/37521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75391b56 to 127.0.0.1:53187 2023-07-21 05:12:48,791 DEBUG [Listener at jenkins-hbase4.apache.org/37521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:48,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:12:48,791 INFO [Listener at jenkins-hbase4.apache.org/37521] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39445,1689916199184' ***** 2023-07-21 05:12:48,791 DEBUG [Listener at jenkins-hbase4.apache.org/37521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:48,792 INFO [Listener at jenkins-hbase4.apache.org/37521] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 05:12:48,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:12:48,792 INFO [Listener at jenkins-hbase4.apache.org/37521] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46441,1689916199266' ***** 2023-07-21 05:12:48,792 INFO [RS:0;jenkins-hbase4:39445] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 05:12:48,792 INFO [RS:0;jenkins-hbase4:39445] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 05:12:48,792 DEBUG [Listener at jenkins-hbase4.apache.org/37521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:48,792 INFO [RS:0;jenkins-hbase4:39445] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 05:12:48,792 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 05:12:48,792 INFO [Listener at jenkins-hbase4.apache.org/37521] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 05:12:48,792 INFO [Listener at jenkins-hbase4.apache.org/37521] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36249,1689916199318' ***** 2023-07-21 05:12:48,792 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(3305): Received CLOSE for c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:12:48,792 DEBUG [Listener at jenkins-hbase4.apache.org/37521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:48,793 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:48,793 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:48,793 INFO [RS:1;jenkins-hbase4:46441] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 05:12:48,794 DEBUG [RS:0;jenkins-hbase4:39445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34925bcb to 127.0.0.1:53187 2023-07-21 05:12:48,794 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 05:12:48,794 DEBUG [RS:0;jenkins-hbase4:39445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:48,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c465e3321f42730c1e28c4b4da3540ed, disabling compactions & flushes 2023-07-21 05:12:48,798 INFO [Listener at jenkins-hbase4.apache.org/37521] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 05:12:48,796 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:48,796 INFO [RS:0;jenkins-hbase4:39445] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 05:12:48,799 INFO [RS:2;jenkins-hbase4:36249] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 05:12:48,794 INFO [RS:1;jenkins-hbase4:46441] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 05:12:48,799 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 05:12:48,799 INFO [RS:1;jenkins-hbase4:46441] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 05:12:48,799 INFO [RS:2;jenkins-hbase4:36249] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 05:12:48,799 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(3305): Received CLOSE for db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:12:48,799 INFO [RS:0;jenkins-hbase4:39445] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 05:12:48,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:12:48,799 INFO [RS:0;jenkins-hbase4:39445] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 05:12:48,799 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:48,800 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-21 05:12:48,799 INFO [RS:2;jenkins-hbase4:36249] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 05:12:48,800 DEBUG [RS:1;jenkins-hbase4:46441] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60eff91a to 127.0.0.1:53187 2023-07-21 05:12:48,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db1146cd61caeaf377a85879b445d9a7, disabling compactions & flushes 2023-07-21 05:12:48,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:12:48,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:12:48,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. after waiting 0 ms 2023-07-21 05:12:48,800 DEBUG [RS:1;jenkins-hbase4:46441] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:48,800 INFO [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:48,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:12:48,800 DEBUG [RS:2;jenkins-hbase4:36249] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56b4d19a to 127.0.0.1:53187 2023-07-21 05:12:48,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:12:48,800 DEBUG [RS:2;jenkins-hbase4:36249] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:48,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c465e3321f42730c1e28c4b4da3540ed 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-21 05:12:48,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. after waiting 0 ms 2023-07-21 05:12:48,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:12:48,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing db1146cd61caeaf377a85879b445d9a7 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-21 05:12:48,805 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-21 05:12:48,805 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, c465e3321f42730c1e28c4b4da3540ed=hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed.} 2023-07-21 05:12:48,806 DEBUG [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1504): Waiting on 1588230740, c465e3321f42730c1e28c4b4da3540ed 2023-07-21 05:12:48,807 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 05:12:48,807 INFO [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36249,1689916199318; all regions closed. 2023-07-21 05:12:48,807 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1478): Online Regions={db1146cd61caeaf377a85879b445d9a7=hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7.} 2023-07-21 05:12:48,807 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 05:12:48,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 05:12:48,813 DEBUG [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1504): Waiting on db1146cd61caeaf377a85879b445d9a7 2023-07-21 05:12:48,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 05:12:48,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 05:12:48,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 05:12:48,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-21 05:12:48,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed/.tmp/info/0465f69b7bfe455fa27ce1e772446cf4 2023-07-21 05:12:48,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7/.tmp/l/3d952e1729b54c9b951d58586c3cc83a 2023-07-21 05:12:48,859 DEBUG [RS:2;jenkins-hbase4:36249] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/oldWALs 2023-07-21 05:12:48,859 INFO [RS:2;jenkins-hbase4:36249] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36249%2C1689916199318:(num 1689916201582) 2023-07-21 05:12:48,859 DEBUG [RS:2;jenkins-hbase4:36249] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:48,859 INFO [RS:2;jenkins-hbase4:36249] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:48,860 INFO [RS:2;jenkins-hbase4:36249] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 05:12:48,860 INFO [RS:2;jenkins-hbase4:36249] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 05:12:48,860 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 05:12:48,860 INFO [RS:2;jenkins-hbase4:36249] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 05:12:48,860 INFO [RS:2;jenkins-hbase4:36249] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 05:12:48,861 INFO [RS:2;jenkins-hbase4:36249] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36249 2023-07-21 05:12:48,864 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/.tmp/info/0ff0dc621122442d97916f36b150d916 2023-07-21 05:12:48,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d952e1729b54c9b951d58586c3cc83a 2023-07-21 05:12:48,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7/.tmp/l/3d952e1729b54c9b951d58586c3cc83a as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7/l/3d952e1729b54c9b951d58586c3cc83a 2023-07-21 05:12:48,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed/.tmp/info/0465f69b7bfe455fa27ce1e772446cf4 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed/info/0465f69b7bfe455fa27ce1e772446cf4 2023-07-21 05:12:48,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ff0dc621122442d97916f36b150d916 2023-07-21 05:12:48,872 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:48,872 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:48,872 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:48,872 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:48,872 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36249,1689916199318 2023-07-21 05:12:48,872 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:48,872 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:48,873 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36249,1689916199318] 2023-07-21 05:12:48,873 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36249,1689916199318; numProcessing=1 2023-07-21 05:12:48,875 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36249,1689916199318 already deleted, retry=false 2023-07-21 05:12:48,875 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36249,1689916199318 expired; onlineServers=2 2023-07-21 05:12:48,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed/info/0465f69b7bfe455fa27ce1e772446cf4, entries=2, sequenceid=6, filesize=4.8 K 2023-07-21 05:12:48,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c465e3321f42730c1e28c4b4da3540ed in 79ms, sequenceid=6, compaction requested=false 2023-07-21 05:12:48,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d952e1729b54c9b951d58586c3cc83a 2023-07-21 05:12:48,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7/l/3d952e1729b54c9b951d58586c3cc83a, entries=7, sequenceid=18, filesize=5.2 K 2023-07-21 05:12:48,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for db1146cd61caeaf377a85879b445d9a7 in 80ms, sequenceid=18, compaction requested=false 2023-07-21 05:12:48,889 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:48,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/namespace/c465e3321f42730c1e28c4b4da3540ed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:12:48,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:48,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:12:48,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c465e3321f42730c1e28c4b4da3540ed: 2023-07-21 05:12:48,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689916202114.c465e3321f42730c1e28c4b4da3540ed. 2023-07-21 05:12:48,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/acl/db1146cd61caeaf377a85879b445d9a7/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-21 05:12:48,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:48,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:12:48,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db1146cd61caeaf377a85879b445d9a7: 2023-07-21 05:12:48,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689916202901.db1146cd61caeaf377a85879b445d9a7. 2023-07-21 05:12:48,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/.tmp/rep_barrier/e6cc29941e484b40870403ec99dd4dcd 2023-07-21 05:12:48,906 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6cc29941e484b40870403ec99dd4dcd 2023-07-21 05:12:48,936 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/.tmp/table/b96ab9d7abe548e59630cbc520ee5fe6 2023-07-21 05:12:48,940 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b96ab9d7abe548e59630cbc520ee5fe6 2023-07-21 05:12:48,941 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/.tmp/info/0ff0dc621122442d97916f36b150d916 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/info/0ff0dc621122442d97916f36b150d916 2023-07-21 05:12:48,946 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ff0dc621122442d97916f36b150d916 2023-07-21 05:12:48,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/info/0ff0dc621122442d97916f36b150d916, entries=48, sequenceid=131, filesize=10.3 K 2023-07-21 05:12:48,948 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/.tmp/rep_barrier/e6cc29941e484b40870403ec99dd4dcd as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/rep_barrier/e6cc29941e484b40870403ec99dd4dcd 2023-07-21 05:12:48,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6cc29941e484b40870403ec99dd4dcd 2023-07-21 05:12:48,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/rep_barrier/e6cc29941e484b40870403ec99dd4dcd, entries=13, sequenceid=131, filesize=6.4 K 2023-07-21 05:12:48,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/.tmp/table/b96ab9d7abe548e59630cbc520ee5fe6 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/table/b96ab9d7abe548e59630cbc520ee5fe6 2023-07-21 05:12:48,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b96ab9d7abe548e59630cbc520ee5fe6 2023-07-21 05:12:48,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/table/b96ab9d7abe548e59630cbc520ee5fe6, entries=24, sequenceid=131, filesize=6.9 K 2023-07-21 05:12:48,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 155ms, sequenceid=131, compaction requested=false 2023-07-21 05:12:48,976 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:48,976 INFO [RS:2;jenkins-hbase4:36249] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36249,1689916199318; zookeeper connection closed. 2023-07-21 05:12:48,976 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:36249-0x10186494aba0003, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:48,981 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2be75d9e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2be75d9e 2023-07-21 05:12:48,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-21 05:12:48,986 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:48,986 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 05:12:48,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 05:12:48,987 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 05:12:48,987 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-21 05:12:49,007 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39445,1689916199184; all regions closed. 2023-07-21 05:12:49,013 DEBUG [RS:0;jenkins-hbase4:39445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/oldWALs 2023-07-21 05:12:49,013 INFO [RS:0;jenkins-hbase4:39445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39445%2C1689916199184.meta:.meta(num 1689916201728) 2023-07-21 05:12:49,013 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46441,1689916199266; all regions closed. 2023-07-21 05:12:49,023 DEBUG [RS:1;jenkins-hbase4:46441] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/oldWALs 2023-07-21 05:12:49,023 INFO [RS:1;jenkins-hbase4:46441] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46441%2C1689916199266:(num 1689916201578) 2023-07-21 05:12:49,024 DEBUG [RS:1;jenkins-hbase4:46441] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:49,024 DEBUG [RS:0;jenkins-hbase4:39445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/oldWALs 2023-07-21 05:12:49,024 INFO [RS:0;jenkins-hbase4:39445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39445%2C1689916199184:(num 1689916201578) 2023-07-21 05:12:49,024 DEBUG [RS:0;jenkins-hbase4:39445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:49,024 INFO [RS:0;jenkins-hbase4:39445] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:49,024 INFO [RS:1;jenkins-hbase4:46441] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:49,024 INFO [RS:1;jenkins-hbase4:46441] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 05:12:49,024 INFO [RS:0;jenkins-hbase4:39445] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 05:12:49,025 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 05:12:49,025 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 05:12:49,025 INFO [RS:1;jenkins-hbase4:46441] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 05:12:49,025 INFO [RS:1;jenkins-hbase4:46441] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 05:12:49,025 INFO [RS:1;jenkins-hbase4:46441] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 05:12:49,026 INFO [RS:1;jenkins-hbase4:46441] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46441 2023-07-21 05:12:49,029 INFO [RS:0;jenkins-hbase4:39445] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39445 2023-07-21 05:12:49,031 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:49,031 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:49,031 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46441,1689916199266 2023-07-21 05:12:49,035 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:49,035 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46441,1689916199266] 2023-07-21 05:12:49,035 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46441,1689916199266; numProcessing=2 2023-07-21 05:12:49,035 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39445,1689916199184 2023-07-21 05:12:49,037 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46441,1689916199266 already deleted, retry=false 2023-07-21 05:12:49,037 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46441,1689916199266 expired; onlineServers=1 2023-07-21 05:12:49,037 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39445,1689916199184] 2023-07-21 05:12:49,038 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39445,1689916199184; numProcessing=3 2023-07-21 05:12:49,137 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:49,137 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:46441-0x10186494aba0002, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:49,137 INFO [RS:1;jenkins-hbase4:46441] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46441,1689916199266; zookeeper connection closed. 2023-07-21 05:12:49,137 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@74b327f6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@74b327f6 2023-07-21 05:12:49,138 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:49,138 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): regionserver:39445-0x10186494aba0001, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:49,138 INFO [RS:0;jenkins-hbase4:39445] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39445,1689916199184; zookeeper connection closed. 2023-07-21 05:12:49,138 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@f2e6248] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@f2e6248 2023-07-21 05:12:49,139 INFO [Listener at jenkins-hbase4.apache.org/37521] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-21 05:12:49,139 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39445,1689916199184 already deleted, retry=false 2023-07-21 05:12:49,139 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39445,1689916199184 expired; onlineServers=0 2023-07-21 05:12:49,139 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38519,1689916197810' ***** 2023-07-21 05:12:49,139 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-21 05:12:49,140 DEBUG [M:0;jenkins-hbase4:38519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43d5bc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 05:12:49,140 INFO [M:0;jenkins-hbase4:38519] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38519,1689916197810 2023-07-21 05:12:49,140 INFO [M:0;jenkins-hbase4:38519] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38519,1689916197810; all regions closed. 2023-07-21 05:12:49,140 DEBUG [M:0;jenkins-hbase4:38519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:49,140 DEBUG [M:0;jenkins-hbase4:38519] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-21 05:12:49,140 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-21 05:12:49,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689916201056] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689916201056,5,FailOnTimeoutGroup] 2023-07-21 05:12:49,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689916201056] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689916201056,5,FailOnTimeoutGroup] 2023-07-21 05:12:49,140 DEBUG [M:0;jenkins-hbase4:38519] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-21 05:12:49,140 INFO [M:0;jenkins-hbase4:38519] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-21 05:12:49,140 INFO [M:0;jenkins-hbase4:38519] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-21 05:12:49,141 INFO [M:0;jenkins-hbase4:38519] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-21 05:12:49,141 DEBUG [M:0;jenkins-hbase4:38519] master.HMaster(1512): Stopping service threads 2023-07-21 05:12:49,141 INFO [M:0;jenkins-hbase4:38519] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-21 05:12:49,141 ERROR [M:0;jenkins-hbase4:38519] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-21 05:12:49,141 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-21 05:12:49,141 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:12:49,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:12:49,142 INFO [M:0;jenkins-hbase4:38519] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-21 05:12:49,142 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-21 05:12:49,142 DEBUG [M:0;jenkins-hbase4:38519] zookeeper.ZKUtil(398): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-21 05:12:49,143 WARN [M:0;jenkins-hbase4:38519] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-21 05:12:49,143 INFO [M:0;jenkins-hbase4:38519] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-21 05:12:49,143 INFO [M:0;jenkins-hbase4:38519] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-21 05:12:49,143 DEBUG [M:0;jenkins-hbase4:38519] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 05:12:49,144 INFO [M:0;jenkins-hbase4:38519] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:12:49,144 DEBUG [M:0;jenkins-hbase4:38519] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:12:49,144 DEBUG [M:0;jenkins-hbase4:38519] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 05:12:49,144 DEBUG [M:0;jenkins-hbase4:38519] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:12:49,144 INFO [M:0;jenkins-hbase4:38519] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.41 KB heapSize=449.63 KB 2023-07-21 05:12:49,173 INFO [M:0;jenkins-hbase4:38519] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.41 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9ba886af29514f108d33f7b070c404f9 2023-07-21 05:12:49,179 INFO [M:0;jenkins-hbase4:38519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ba886af29514f108d33f7b070c404f9 2023-07-21 05:12:49,180 DEBUG [M:0;jenkins-hbase4:38519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9ba886af29514f108d33f7b070c404f9 as hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9ba886af29514f108d33f7b070c404f9 2023-07-21 05:12:49,188 INFO [M:0;jenkins-hbase4:38519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ba886af29514f108d33f7b070c404f9 2023-07-21 05:12:49,188 INFO [M:0;jenkins-hbase4:38519] regionserver.HStore(1080): Added hdfs://localhost:36811/user/jenkins/test-data/9639fe04-addd-4d6e-0e45-4565438f4aab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9ba886af29514f108d33f7b070c404f9, entries=119, sequenceid=899, filesize=28.4 K 2023-07-21 05:12:49,189 INFO [M:0;jenkins-hbase4:38519] regionserver.HRegion(2948): Finished flush of dataSize ~373.41 KB/382368, heapSize ~449.62 KB/460408, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 45ms, sequenceid=899, compaction requested=false 2023-07-21 05:12:49,196 INFO [M:0;jenkins-hbase4:38519] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:12:49,196 DEBUG [M:0;jenkins-hbase4:38519] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 05:12:49,206 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 05:12:49,206 INFO [M:0;jenkins-hbase4:38519] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-21 05:12:49,207 INFO [M:0;jenkins-hbase4:38519] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38519 2023-07-21 05:12:49,209 DEBUG [M:0;jenkins-hbase4:38519] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38519,1689916197810 already deleted, retry=false 2023-07-21 05:12:49,311 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:49,311 INFO [M:0;jenkins-hbase4:38519] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38519,1689916197810; zookeeper connection closed. 2023-07-21 05:12:49,311 DEBUG [Listener at localhost/36037-EventThread] zookeeper.ZKWatcher(600): master:38519-0x10186494aba0000, quorum=127.0.0.1:53187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:49,313 WARN [Listener at jenkins-hbase4.apache.org/37521] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 05:12:49,324 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 05:12:49,428 WARN [BP-1675002095-172.31.14.131-1689916193510 heartbeating to localhost/127.0.0.1:36811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 05:12:49,428 WARN [BP-1675002095-172.31.14.131-1689916193510 heartbeating to localhost/127.0.0.1:36811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1675002095-172.31.14.131-1689916193510 (Datanode Uuid 8ca32a74-36ea-4a45-b328-6ddec81e2657) service to localhost/127.0.0.1:36811 2023-07-21 05:12:49,430 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data5/current/BP-1675002095-172.31.14.131-1689916193510] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:49,431 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data6/current/BP-1675002095-172.31.14.131-1689916193510] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:49,433 WARN [Listener at jenkins-hbase4.apache.org/37521] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 05:12:49,435 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 05:12:49,539 WARN [BP-1675002095-172.31.14.131-1689916193510 heartbeating to localhost/127.0.0.1:36811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 05:12:49,539 WARN [BP-1675002095-172.31.14.131-1689916193510 heartbeating to localhost/127.0.0.1:36811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1675002095-172.31.14.131-1689916193510 (Datanode Uuid d82687ec-c166-44c0-af50-c5eb31ec2a96) service to localhost/127.0.0.1:36811 2023-07-21 05:12:49,540 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data3/current/BP-1675002095-172.31.14.131-1689916193510] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:49,540 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data4/current/BP-1675002095-172.31.14.131-1689916193510] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:49,541 WARN [Listener at jenkins-hbase4.apache.org/37521] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 05:12:49,546 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 05:12:49,650 WARN [BP-1675002095-172.31.14.131-1689916193510 heartbeating to localhost/127.0.0.1:36811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 05:12:49,650 WARN [BP-1675002095-172.31.14.131-1689916193510 heartbeating to localhost/127.0.0.1:36811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1675002095-172.31.14.131-1689916193510 (Datanode Uuid 1dee6154-569f-41f2-8216-113db5354bec) service to localhost/127.0.0.1:36811 2023-07-21 05:12:49,651 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data1/current/BP-1675002095-172.31.14.131-1689916193510] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:49,651 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b247189f-c435-313e-c19d-9a6035726cff/cluster_9a5fb2ae-485e-0443-45c3-e135dcef214d/dfs/data/data2/current/BP-1675002095-172.31.14.131-1689916193510] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:49,677 INFO [Listener at jenkins-hbase4.apache.org/37521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 05:12:49,815 INFO [Listener at jenkins-hbase4.apache.org/37521] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-21 05:12:49,939 INFO [Listener at jenkins-hbase4.apache.org/37521] hbase.HBaseTestingUtility(1293): Minicluster is down