2023-07-11 21:46:47,774 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-11 21:46:48,130 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8 2023-07-11 21:46:48,130 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-11 21:46:48,131 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-11 21:46:48,203 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 21:46:48,670 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 21:46:48,670 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb, deleteOnExit=true 2023-07-11 21:46:48,671 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 21:46:48,672 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/test.cache.data in system properties and HBase conf 2023-07-11 21:46:48,673 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 21:46:48,673 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop.log.dir in system properties and HBase conf 2023-07-11 21:46:48,674 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 21:46:48,674 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 21:46:48,675 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 21:46:49,164 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 21:46:49,173 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:46:49,173 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:46:49,174 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 21:46:49,174 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:46:49,174 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 21:46:49,175 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 21:46:49,176 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:46:49,177 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:46:49,177 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 21:46:49,178 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/nfs.dump.dir in system properties and HBase conf 2023-07-11 21:46:49,178 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir in system properties and HBase conf 2023-07-11 21:46:49,178 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:46:49,179 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 21:46:49,179 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 21:46:50,100 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:46:50,107 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:46:50,580 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 21:46:50,835 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 21:46:50,861 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:46:50,939 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:46:51,012 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir/Jetty_localhost_localdomain_37935_hdfs____.5kg2wf/webapp 2023-07-11 21:46:51,246 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:37935 2023-07-11 21:46:51,356 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:46:51,356 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:46:52,145 WARN [Listener at localhost.localdomain/37147] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:46:52,309 WARN [Listener at localhost.localdomain/37147] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:46:52,348 WARN [Listener at localhost.localdomain/37147] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:46:52,360 INFO [Listener at localhost.localdomain/37147] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:46:52,377 INFO [Listener at localhost.localdomain/37147] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir/Jetty_localhost_40109_datanode____.5lks2j/webapp 2023-07-11 21:46:52,494 INFO [Listener at localhost.localdomain/37147] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40109 2023-07-11 21:46:53,201 WARN [Listener at localhost.localdomain/44995] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:46:53,242 WARN [Listener at localhost.localdomain/44995] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:46:53,245 WARN [Listener at localhost.localdomain/44995] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:46:53,247 INFO [Listener at localhost.localdomain/44995] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:46:53,257 INFO [Listener at localhost.localdomain/44995] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir/Jetty_localhost_46009_datanode____.a5rwo2/webapp 2023-07-11 21:46:53,359 INFO [Listener at localhost.localdomain/44995] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46009 2023-07-11 21:46:53,379 WARN [Listener at localhost.localdomain/43399] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:46:53,442 WARN [Listener at localhost.localdomain/43399] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:46:53,446 WARN [Listener at localhost.localdomain/43399] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:46:53,447 INFO [Listener at localhost.localdomain/43399] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:46:53,456 INFO [Listener at localhost.localdomain/43399] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir/Jetty_localhost_38637_datanode____dr6xvg/webapp 2023-07-11 21:46:53,571 INFO [Listener at localhost.localdomain/43399] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38637 2023-07-11 21:46:53,596 WARN [Listener at localhost.localdomain/45553] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:46:54,671 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12dc25882c186803: Processing first storage report for DS-ef8315fa-0384-4735-8c3c-58f433e18950 from datanode 3bf1af91-b830-442b-a411-c6bb229fbbf7 2023-07-11 21:46:54,673 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12dc25882c186803: from storage DS-ef8315fa-0384-4735-8c3c-58f433e18950 node DatanodeRegistration(127.0.0.1:46083, datanodeUuid=3bf1af91-b830-442b-a411-c6bb229fbbf7, infoPort=35073, infoSecurePort=0, ipcPort=43399, storageInfo=lv=-57;cid=testClusterID;nsid=1710666138;c=1689112010272), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-11 21:46:54,674 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdfcd343e6960c14e: Processing first storage report for DS-5b875888-df13-4702-8be4-f785f6a1da2a from datanode c091bb12-e372-4d16-8f2e-68039060b54c 2023-07-11 21:46:54,674 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdfcd343e6960c14e: from storage DS-5b875888-df13-4702-8be4-f785f6a1da2a node DatanodeRegistration(127.0.0.1:41703, datanodeUuid=c091bb12-e372-4d16-8f2e-68039060b54c, infoPort=34041, infoSecurePort=0, ipcPort=44995, storageInfo=lv=-57;cid=testClusterID;nsid=1710666138;c=1689112010272), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 21:46:54,675 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd6fb26a25727f46d: Processing first storage report for DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4 from datanode e82a7423-cd26-4c1b-973a-6f20afe38158 2023-07-11 21:46:54,675 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd6fb26a25727f46d: from storage DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4 node DatanodeRegistration(127.0.0.1:33695, datanodeUuid=e82a7423-cd26-4c1b-973a-6f20afe38158, infoPort=33481, infoSecurePort=0, ipcPort=45553, storageInfo=lv=-57;cid=testClusterID;nsid=1710666138;c=1689112010272), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 21:46:54,675 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12dc25882c186803: Processing first storage report for DS-e212785a-df9f-44d7-9264-31125fbb765f from datanode 3bf1af91-b830-442b-a411-c6bb229fbbf7 2023-07-11 21:46:54,676 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12dc25882c186803: from storage DS-e212785a-df9f-44d7-9264-31125fbb765f node DatanodeRegistration(127.0.0.1:46083, datanodeUuid=3bf1af91-b830-442b-a411-c6bb229fbbf7, infoPort=35073, infoSecurePort=0, ipcPort=43399, storageInfo=lv=-57;cid=testClusterID;nsid=1710666138;c=1689112010272), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:46:54,676 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdfcd343e6960c14e: Processing first storage report for DS-68fed8d9-fee5-404b-bebd-fd2cb97476ef from datanode c091bb12-e372-4d16-8f2e-68039060b54c 2023-07-11 21:46:54,676 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdfcd343e6960c14e: from storage DS-68fed8d9-fee5-404b-bebd-fd2cb97476ef node DatanodeRegistration(127.0.0.1:41703, datanodeUuid=c091bb12-e372-4d16-8f2e-68039060b54c, infoPort=34041, infoSecurePort=0, ipcPort=44995, storageInfo=lv=-57;cid=testClusterID;nsid=1710666138;c=1689112010272), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 21:46:54,676 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd6fb26a25727f46d: Processing first storage report for DS-ab565b37-6bbd-435b-b5d4-d9542467e9e0 from datanode e82a7423-cd26-4c1b-973a-6f20afe38158 2023-07-11 21:46:54,677 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd6fb26a25727f46d: from storage DS-ab565b37-6bbd-435b-b5d4-d9542467e9e0 node DatanodeRegistration(127.0.0.1:33695, datanodeUuid=e82a7423-cd26-4c1b-973a-6f20afe38158, infoPort=33481, infoSecurePort=0, ipcPort=45553, storageInfo=lv=-57;cid=testClusterID;nsid=1710666138;c=1689112010272), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:46:54,713 DEBUG [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8 2023-07-11 21:46:54,905 INFO [Listener at localhost.localdomain/45553] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/zookeeper_0, clientPort=59736, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 21:46:54,947 INFO [Listener at localhost.localdomain/45553] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59736 2023-07-11 21:46:54,967 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:54,973 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:55,831 INFO [Listener at localhost.localdomain/45553] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e with version=8 2023-07-11 21:46:55,831 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/hbase-staging 2023-07-11 21:46:56,219 INFO [Listener at localhost.localdomain/45553] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 21:46:56,975 INFO [Listener at localhost.localdomain/45553] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-11 21:46:57,017 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:57,018 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:57,018 INFO [Listener at localhost.localdomain/45553] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:46:57,019 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:57,019 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:46:57,234 INFO [Listener at localhost.localdomain/45553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:46:57,338 DEBUG [Listener at localhost.localdomain/45553] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 21:46:57,463 INFO [Listener at localhost.localdomain/45553] ipc.NettyRpcServer(120): Bind to /136.243.18.41:44551 2023-07-11 21:46:57,482 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:57,484 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:57,514 INFO [Listener at localhost.localdomain/45553] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44551 connecting to ZooKeeper ensemble=127.0.0.1:59736 2023-07-11 21:46:57,669 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:445510x0, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:46:57,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44551-0x10156596b270000 connected 2023-07-11 21:46:57,833 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:46:57,835 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:46:57,855 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:46:57,878 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44551 2023-07-11 21:46:57,881 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44551 2023-07-11 21:46:57,892 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44551 2023-07-11 21:46:57,912 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44551 2023-07-11 21:46:57,916 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44551 2023-07-11 21:46:57,924 INFO [Listener at localhost.localdomain/45553] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e, hbase.cluster.distributed=false 2023-07-11 21:46:58,019 INFO [Listener at localhost.localdomain/45553] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-11 21:46:58,019 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,019 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,020 INFO [Listener at localhost.localdomain/45553] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:46:58,020 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,020 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:46:58,025 INFO [Listener at localhost.localdomain/45553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:46:58,030 INFO [Listener at localhost.localdomain/45553] ipc.NettyRpcServer(120): Bind to /136.243.18.41:46731 2023-07-11 21:46:58,034 INFO [Listener at localhost.localdomain/45553] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:46:58,048 INFO [Listener at localhost.localdomain/45553] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 21:46:58,054 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:58,056 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:58,059 INFO [Listener at localhost.localdomain/45553] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46731 connecting to ZooKeeper ensemble=127.0.0.1:59736 2023-07-11 21:46:58,065 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:467310x0, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:46:58,066 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:467310x0, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:46:58,069 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:467310x0, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:46:58,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46731-0x10156596b270001 connected 2023-07-11 21:46:58,071 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:46:58,078 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46731 2023-07-11 21:46:58,080 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46731 2023-07-11 21:46:58,083 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46731 2023-07-11 21:46:58,085 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46731 2023-07-11 21:46:58,086 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46731 2023-07-11 21:46:58,102 INFO [Listener at localhost.localdomain/45553] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-11 21:46:58,102 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,103 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,104 INFO [Listener at localhost.localdomain/45553] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:46:58,104 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,105 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:46:58,105 INFO [Listener at localhost.localdomain/45553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:46:58,108 INFO [Listener at localhost.localdomain/45553] ipc.NettyRpcServer(120): Bind to /136.243.18.41:34193 2023-07-11 21:46:58,109 INFO [Listener at localhost.localdomain/45553] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:46:58,116 INFO [Listener at localhost.localdomain/45553] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 21:46:58,117 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:58,148 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:58,150 INFO [Listener at localhost.localdomain/45553] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34193 connecting to ZooKeeper ensemble=127.0.0.1:59736 2023-07-11 21:46:58,178 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:341930x0, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:46:58,180 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:341930x0, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:46:58,182 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:341930x0, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:46:58,188 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:341930x0, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:46:58,212 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34193 2023-07-11 21:46:58,214 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34193 2023-07-11 21:46:58,230 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34193 2023-07-11 21:46:58,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34193-0x10156596b270002 connected 2023-07-11 21:46:58,244 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34193 2023-07-11 21:46:58,251 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34193 2023-07-11 21:46:58,270 INFO [Listener at localhost.localdomain/45553] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-11 21:46:58,270 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,271 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,271 INFO [Listener at localhost.localdomain/45553] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:46:58,271 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:46:58,271 INFO [Listener at localhost.localdomain/45553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:46:58,271 INFO [Listener at localhost.localdomain/45553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:46:58,274 INFO [Listener at localhost.localdomain/45553] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35055 2023-07-11 21:46:58,275 INFO [Listener at localhost.localdomain/45553] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:46:58,289 INFO [Listener at localhost.localdomain/45553] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 21:46:58,291 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:58,293 INFO [Listener at localhost.localdomain/45553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:58,295 INFO [Listener at localhost.localdomain/45553] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35055 connecting to ZooKeeper ensemble=127.0.0.1:59736 2023-07-11 21:46:58,322 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:350550x0, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:46:58,324 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:350550x0, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:46:58,328 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:350550x0, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:46:58,330 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ZKUtil(164): regionserver:350550x0, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:46:58,340 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35055 2023-07-11 21:46:58,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35055-0x10156596b270003 connected 2023-07-11 21:46:58,341 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35055 2023-07-11 21:46:58,359 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35055 2023-07-11 21:46:58,360 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35055 2023-07-11 21:46:58,372 DEBUG [Listener at localhost.localdomain/45553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35055 2023-07-11 21:46:58,401 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:46:58,427 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:46:58,430 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:46:58,475 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:46:58,475 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:46:58,475 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:46:58,475 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:46:58,476 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:46:58,479 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:46:58,484 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,44551,1689112016009 from backup master directory 2023-07-11 21:46:58,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:46:58,497 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:46:58,498 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:46:58,498 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:46:58,499 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:46:58,505 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 21:46:58,509 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 21:46:58,793 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/hbase.id with ID: 69028457-acb3-46cc-a779-11d6e8f76d49 2023-07-11 21:46:58,886 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:46:58,928 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:46:59,184 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x31d2f99c to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:46:59,318 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@447af6c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:46:59,361 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:46:59,363 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 21:46:59,396 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 21:46:59,396 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 21:46:59,400 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:46:59,406 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:46:59,408 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:46:59,461 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store-tmp 2023-07-11 21:46:59,542 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:46:59,543 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:46:59,543 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:46:59,543 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:46:59,543 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:46:59,543 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:46:59,543 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:46:59,543 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:46:59,554 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/WALs/jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:46:59,589 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44551%2C1689112016009, suffix=, logDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/WALs/jenkins-hbase17.apache.org,44551,1689112016009, archiveDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/oldWALs, maxLogs=10 2023-07-11 21:46:59,713 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK] 2023-07-11 21:46:59,721 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK] 2023-07-11 21:46:59,721 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK] 2023-07-11 21:46:59,733 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:46:59,836 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/WALs/jenkins-hbase17.apache.org,44551,1689112016009/jenkins-hbase17.apache.org%2C44551%2C1689112016009.1689112019607 2023-07-11 21:46:59,837 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK], DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK], DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK]] 2023-07-11 21:46:59,838 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:46:59,839 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:46:59,843 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:46:59,847 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:46:59,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:46:59,968 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 21:47:00,015 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 21:47:00,029 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:00,036 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:47:00,039 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:47:00,058 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:47:00,066 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:47:00,068 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59669436, jitterRate=-0.11085611581802368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:47:00,069 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:47:00,070 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 21:47:00,101 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 21:47:00,102 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 21:47:00,105 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 21:47:00,107 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 21:47:00,158 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 50 msec 2023-07-11 21:47:00,159 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 21:47:00,199 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 21:47:00,207 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 21:47:00,243 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 21:47:00,251 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 21:47:00,253 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 21:47:00,264 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 21:47:00,271 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 21:47:00,278 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:47:00,280 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 21:47:00,281 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 21:47:00,297 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 21:47:00,303 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:47:00,303 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:47:00,304 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:47:00,303 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:47:00,309 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,44551,1689112016009, sessionid=0x10156596b270000, setting cluster-up flag (Was=false) 2023-07-11 21:47:00,304 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:47:00,333 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:47:00,342 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 21:47:00,354 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:47:00,363 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:47:00,371 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 21:47:00,375 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:47:00,380 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp 2023-07-11 21:47:00,407 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(951): ClusterId : 69028457-acb3-46cc-a779-11d6e8f76d49 2023-07-11 21:47:00,431 DEBUG [RS:0;jenkins-hbase17:46731] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:47:00,432 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(951): ClusterId : 69028457-acb3-46cc-a779-11d6e8f76d49 2023-07-11 21:47:00,435 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(951): ClusterId : 69028457-acb3-46cc-a779-11d6e8f76d49 2023-07-11 21:47:00,445 DEBUG [RS:0;jenkins-hbase17:46731] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:47:00,448 DEBUG [RS:0;jenkins-hbase17:46731] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:47:00,435 DEBUG [RS:1;jenkins-hbase17:34193] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:47:00,460 DEBUG [RS:2;jenkins-hbase17:35055] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:47:00,463 DEBUG [RS:0;jenkins-hbase17:46731] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:47:00,463 DEBUG [RS:1;jenkins-hbase17:34193] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:47:00,463 DEBUG [RS:2;jenkins-hbase17:35055] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:47:00,463 DEBUG [RS:1;jenkins-hbase17:34193] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:47:00,464 DEBUG [RS:2;jenkins-hbase17:35055] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:47:00,468 DEBUG [RS:2;jenkins-hbase17:35055] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:47:00,466 DEBUG [RS:0;jenkins-hbase17:46731] zookeeper.ReadOnlyZKClient(139): Connect 0x64f2c721 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:00,473 DEBUG [RS:2;jenkins-hbase17:35055] zookeeper.ReadOnlyZKClient(139): Connect 0x0a959f41 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:00,473 DEBUG [RS:1;jenkins-hbase17:34193] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:47:00,521 DEBUG [RS:1;jenkins-hbase17:34193] zookeeper.ReadOnlyZKClient(139): Connect 0x3ec33ceb to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:00,560 DEBUG [RS:0;jenkins-hbase17:46731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a3535cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:00,578 DEBUG [RS:0;jenkins-hbase17:46731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e0aac51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-11 21:47:00,584 DEBUG [RS:2;jenkins-hbase17:35055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4526063, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:00,585 DEBUG [RS:2;jenkins-hbase17:35055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6df431, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-11 21:47:00,613 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-11 21:47:00,619 DEBUG [RS:1;jenkins-hbase17:34193] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3004c543, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:00,619 DEBUG [RS:1;jenkins-hbase17:34193] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@343b579b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-11 21:47:00,623 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:00,624 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-11 21:47:00,659 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:34193 2023-07-11 21:47:00,663 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:35055 2023-07-11 21:47:00,674 INFO [RS:2;jenkins-hbase17:35055] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:47:00,674 INFO [RS:2;jenkins-hbase17:35055] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:47:00,674 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 21:47:00,675 INFO [RS:2;jenkins-hbase17:35055] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:00,676 INFO [RS:1;jenkins-hbase17:34193] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:47:00,676 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:47:00,676 INFO [RS:1;jenkins-hbase17:34193] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:47:00,677 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 21:47:00,677 INFO [RS:1;jenkins-hbase17:34193] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:00,677 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:47:00,678 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:46731 2023-07-11 21:47:00,678 INFO [RS:0;jenkins-hbase17:46731] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:47:00,678 INFO [RS:0;jenkins-hbase17:46731] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:47:00,678 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 21:47:00,678 INFO [RS:0;jenkins-hbase17:46731] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:00,679 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:47:00,679 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,44551,1689112016009 with isa=jenkins-hbase17.apache.org/136.243.18.41:35055, startcode=1689112018269 2023-07-11 21:47:00,685 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,44551,1689112016009 with isa=jenkins-hbase17.apache.org/136.243.18.41:34193, startcode=1689112018101 2023-07-11 21:47:00,685 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,44551,1689112016009 with isa=jenkins-hbase17.apache.org/136.243.18.41:46731, startcode=1689112018018 2023-07-11 21:47:00,707 DEBUG [RS:1;jenkins-hbase17:34193] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:47:00,708 DEBUG [RS:0;jenkins-hbase17:46731] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:47:00,707 DEBUG [RS:2;jenkins-hbase17:35055] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:47:00,767 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 21:47:00,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:47:00,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:47:00,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:47:00,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:47:00,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-11 21:47:00,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:00,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:47:00,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:00,791 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689112050791 2023-07-11 21:47:00,791 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53371, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:47:00,791 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53965, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:47:00,791 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52581, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:47:00,794 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 21:47:00,801 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:47:00,803 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 21:47:00,808 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44551] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:47:00,814 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:47:00,822 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44551] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:47:00,823 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44551] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:47:00,825 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 21:47:00,836 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 21:47:00,836 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 21:47:00,837 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 21:47:00,837 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 21:47:00,847 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:00,852 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 21:47:00,852 WARN [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 21:47:00,859 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 21:47:00,859 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 21:47:00,859 WARN [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 21:47:00,859 WARN [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 21:47:00,862 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 21:47:00,865 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 21:47:00,865 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 21:47:00,872 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 21:47:00,873 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 21:47:00,876 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689112020875,5,FailOnTimeoutGroup] 2023-07-11 21:47:00,877 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689112020876,5,FailOnTimeoutGroup] 2023-07-11 21:47:00,877 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:00,878 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 21:47:00,880 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:00,880 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:00,936 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:47:00,937 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:47:00,937 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:47:00,955 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,44551,1689112016009 with isa=jenkins-hbase17.apache.org/136.243.18.41:34193, startcode=1689112018101 2023-07-11 21:47:00,960 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,44551,1689112016009 with isa=jenkins-hbase17.apache.org/136.243.18.41:46731, startcode=1689112018018 2023-07-11 21:47:00,960 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,44551,1689112016009 with isa=jenkins-hbase17.apache.org/136.243.18.41:35055, startcode=1689112018269 2023-07-11 21:47:00,987 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44551] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:00,994 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44551] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:00,995 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44551] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:01,018 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:47:01,018 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37147 2023-07-11 21:47:01,018 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:47:01,023 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:47:01,023 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:47:01,023 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37147 2023-07-11 21:47:01,023 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37147 2023-07-11 21:47:01,023 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:47:01,023 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:47:01,028 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:47:01,029 DEBUG [RS:1;jenkins-hbase17:34193] zookeeper.ZKUtil(162): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:01,030 DEBUG [RS:0;jenkins-hbase17:46731] zookeeper.ZKUtil(162): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:01,030 WARN [RS:1;jenkins-hbase17:34193] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:47:01,030 WARN [RS:0;jenkins-hbase17:46731] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:47:01,041 INFO [RS:0;jenkins-hbase17:46731] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:47:01,041 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:01,033 INFO [RS:1;jenkins-hbase17:34193] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:47:01,043 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:01,046 DEBUG [RS:2;jenkins-hbase17:35055] zookeeper.ZKUtil(162): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:01,046 WARN [RS:2;jenkins-hbase17:35055] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:47:01,046 INFO [RS:2;jenkins-hbase17:35055] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:47:01,047 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:01,058 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,34193,1689112018101] 2023-07-11 21:47:01,088 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,35055,1689112018269] 2023-07-11 21:47:01,090 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,46731,1689112018018] 2023-07-11 21:47:01,133 DEBUG [RS:0;jenkins-hbase17:46731] zookeeper.ZKUtil(162): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:01,133 DEBUG [RS:1;jenkins-hbase17:34193] zookeeper.ZKUtil(162): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:01,134 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:01,136 DEBUG [RS:2;jenkins-hbase17:35055] zookeeper.ZKUtil(162): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:01,136 DEBUG [RS:1;jenkins-hbase17:34193] zookeeper.ZKUtil(162): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:01,136 DEBUG [RS:0;jenkins-hbase17:46731] zookeeper.ZKUtil(162): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:01,137 DEBUG [RS:2;jenkins-hbase17:35055] zookeeper.ZKUtil(162): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:01,137 DEBUG [RS:1;jenkins-hbase17:34193] zookeeper.ZKUtil(162): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:01,137 DEBUG [RS:0;jenkins-hbase17:46731] zookeeper.ZKUtil(162): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:01,138 DEBUG [RS:2;jenkins-hbase17:35055] zookeeper.ZKUtil(162): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:01,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:47:01,163 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/info 2023-07-11 21:47:01,166 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:47:01,168 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:01,168 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:47:01,171 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:47:01,174 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:47:01,175 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:47:01,180 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:47:01,181 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:47:01,184 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:01,185 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:47:01,193 INFO [RS:1;jenkins-hbase17:34193] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:47:01,210 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/table 2023-07-11 21:47:01,211 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:47:01,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:01,216 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740 2023-07-11 21:47:01,204 INFO [RS:2;jenkins-hbase17:35055] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:47:01,204 INFO [RS:0;jenkins-hbase17:46731] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:47:01,225 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740 2023-07-11 21:47:01,246 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 21:47:01,250 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:47:01,278 INFO [RS:1;jenkins-hbase17:34193] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:47:01,300 INFO [RS:2;jenkins-hbase17:35055] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:47:01,303 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:47:01,305 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65418312, jitterRate=-0.025191187858581543}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 21:47:01,305 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:47:01,305 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:47:01,305 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:47:01,306 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:47:01,306 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:47:01,306 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:47:01,311 INFO [RS:0;jenkins-hbase17:46731] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:47:01,328 INFO [RS:1;jenkins-hbase17:34193] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:47:01,328 INFO [RS:1;jenkins-hbase17:34193] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,345 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:47:01,336 INFO [RS:2;jenkins-hbase17:35055] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:47:01,385 INFO [RS:0;jenkins-hbase17:46731] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:47:01,391 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:47:01,391 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:47:01,384 INFO [RS:2;jenkins-hbase17:35055] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,385 INFO [RS:0;jenkins-hbase17:46731] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,394 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:47:01,403 INFO [RS:1;jenkins-hbase17:34193] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,404 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,404 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,404 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,404 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,404 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,404 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:47:01,404 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,405 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,405 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,405 DEBUG [RS:1;jenkins-hbase17:34193] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,438 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:47:01,438 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 21:47:01,444 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:47:01,445 INFO [RS:2;jenkins-hbase17:35055] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,446 INFO [RS:1;jenkins-hbase17:34193] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,447 INFO [RS:1;jenkins-hbase17:34193] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,447 INFO [RS:1;jenkins-hbase17:34193] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,445 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,452 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,452 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,452 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,452 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,452 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:47:01,453 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,453 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,453 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,453 DEBUG [RS:2;jenkins-hbase17:35055] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 21:47:01,481 INFO [RS:0;jenkins-hbase17:46731] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,482 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,482 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,482 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,482 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,483 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,483 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:47:01,483 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,483 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,483 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,483 DEBUG [RS:0;jenkins-hbase17:46731] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:47:01,519 INFO [RS:1;jenkins-hbase17:34193] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:47:01,526 INFO [RS:1;jenkins-hbase17:34193] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,34193,1689112018101-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,553 INFO [RS:0;jenkins-hbase17:46731] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,554 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 21:47:01,554 INFO [RS:0;jenkins-hbase17:46731] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,554 INFO [RS:0;jenkins-hbase17:46731] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,585 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 21:47:01,619 INFO [RS:2;jenkins-hbase17:35055] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,619 INFO [RS:2;jenkins-hbase17:35055] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,619 INFO [RS:2;jenkins-hbase17:35055] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,613 INFO [RS:0;jenkins-hbase17:46731] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:47:01,634 INFO [RS:0;jenkins-hbase17:46731] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,46731,1689112018018-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,648 INFO [RS:2;jenkins-hbase17:35055] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:47:01,656 INFO [RS:2;jenkins-hbase17:35055] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35055,1689112018269-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:01,684 INFO [RS:1;jenkins-hbase17:34193] regionserver.Replication(203): jenkins-hbase17.apache.org,34193,1689112018101 started 2023-07-11 21:47:01,684 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,34193,1689112018101, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:34193, sessionid=0x10156596b270002 2023-07-11 21:47:01,685 DEBUG [RS:1;jenkins-hbase17:34193] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:47:01,685 DEBUG [RS:1;jenkins-hbase17:34193] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:01,685 DEBUG [RS:1;jenkins-hbase17:34193] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,34193,1689112018101' 2023-07-11 21:47:01,685 DEBUG [RS:1;jenkins-hbase17:34193] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:47:01,686 DEBUG [RS:1;jenkins-hbase17:34193] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:47:01,686 DEBUG [RS:1;jenkins-hbase17:34193] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:47:01,686 DEBUG [RS:1;jenkins-hbase17:34193] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:47:01,686 DEBUG [RS:1;jenkins-hbase17:34193] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:01,687 DEBUG [RS:1;jenkins-hbase17:34193] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,34193,1689112018101' 2023-07-11 21:47:01,687 DEBUG [RS:1;jenkins-hbase17:34193] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:01,687 DEBUG [RS:1;jenkins-hbase17:34193] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:01,688 DEBUG [RS:1;jenkins-hbase17:34193] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:47:01,688 INFO [RS:1;jenkins-hbase17:34193] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:47:01,688 INFO [RS:1;jenkins-hbase17:34193] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:47:01,689 INFO [RS:0;jenkins-hbase17:46731] regionserver.Replication(203): jenkins-hbase17.apache.org,46731,1689112018018 started 2023-07-11 21:47:01,689 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,46731,1689112018018, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:46731, sessionid=0x10156596b270001 2023-07-11 21:47:01,690 DEBUG [RS:0;jenkins-hbase17:46731] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:47:01,690 DEBUG [RS:0;jenkins-hbase17:46731] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:01,710 INFO [RS:2;jenkins-hbase17:35055] regionserver.Replication(203): jenkins-hbase17.apache.org,35055,1689112018269 started 2023-07-11 21:47:01,710 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,35055,1689112018269, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:35055, sessionid=0x10156596b270003 2023-07-11 21:47:01,710 DEBUG [RS:2;jenkins-hbase17:35055] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:47:01,710 DEBUG [RS:2;jenkins-hbase17:35055] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:01,693 DEBUG [RS:0;jenkins-hbase17:46731] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,46731,1689112018018' 2023-07-11 21:47:01,711 DEBUG [RS:0;jenkins-hbase17:46731] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:47:01,710 DEBUG [RS:2;jenkins-hbase17:35055] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35055,1689112018269' 2023-07-11 21:47:01,711 DEBUG [RS:2;jenkins-hbase17:35055] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:47:01,712 DEBUG [RS:0;jenkins-hbase17:46731] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:47:01,712 DEBUG [RS:2;jenkins-hbase17:35055] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:47:01,712 DEBUG [RS:0;jenkins-hbase17:46731] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:47:01,712 DEBUG [RS:2;jenkins-hbase17:35055] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:47:01,712 DEBUG [RS:0;jenkins-hbase17:46731] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:47:01,713 DEBUG [RS:2;jenkins-hbase17:35055] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:47:01,713 DEBUG [RS:0;jenkins-hbase17:46731] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:01,713 DEBUG [RS:2;jenkins-hbase17:35055] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:01,713 DEBUG [RS:0;jenkins-hbase17:46731] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,46731,1689112018018' 2023-07-11 21:47:01,713 DEBUG [RS:2;jenkins-hbase17:35055] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35055,1689112018269' 2023-07-11 21:47:01,714 DEBUG [RS:2;jenkins-hbase17:35055] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:01,713 DEBUG [RS:0;jenkins-hbase17:46731] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:01,714 DEBUG [RS:2;jenkins-hbase17:35055] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:01,714 DEBUG [RS:0;jenkins-hbase17:46731] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:01,715 DEBUG [RS:2;jenkins-hbase17:35055] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:47:01,715 DEBUG [RS:0;jenkins-hbase17:46731] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:47:01,715 INFO [RS:2;jenkins-hbase17:35055] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:47:01,716 INFO [RS:0;jenkins-hbase17:46731] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:47:01,716 INFO [RS:2;jenkins-hbase17:35055] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:47:01,717 INFO [RS:0;jenkins-hbase17:46731] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:47:01,740 DEBUG [jenkins-hbase17:44551] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 21:47:01,746 DEBUG [jenkins-hbase17:44551] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:47:01,777 DEBUG [jenkins-hbase17:44551] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:47:01,778 DEBUG [jenkins-hbase17:44551] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:47:01,778 DEBUG [jenkins-hbase17:44551] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:47:01,778 DEBUG [jenkins-hbase17:44551] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:47:01,786 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,34193,1689112018101, state=OPENING 2023-07-11 21:47:01,794 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 21:47:01,795 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:47:01,796 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:47:01,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:47:01,804 INFO [RS:1;jenkins-hbase17:34193] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C34193%2C1689112018101, suffix=, logDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,34193,1689112018101, archiveDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/oldWALs, maxLogs=32 2023-07-11 21:47:01,821 INFO [RS:2;jenkins-hbase17:35055] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35055%2C1689112018269, suffix=, logDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,35055,1689112018269, archiveDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/oldWALs, maxLogs=32 2023-07-11 21:47:01,825 INFO [RS:0;jenkins-hbase17:46731] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C46731%2C1689112018018, suffix=, logDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,46731,1689112018018, archiveDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/oldWALs, maxLogs=32 2023-07-11 21:47:01,955 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK] 2023-07-11 21:47:01,977 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK] 2023-07-11 21:47:02,030 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK] 2023-07-11 21:47:02,030 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK] 2023-07-11 21:47:02,036 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK] 2023-07-11 21:47:02,036 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK] 2023-07-11 21:47:02,050 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK] 2023-07-11 21:47:02,051 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK] 2023-07-11 21:47:02,052 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK] 2023-07-11 21:47:02,080 INFO [RS:1;jenkins-hbase17:34193] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,34193,1689112018101/jenkins-hbase17.apache.org%2C34193%2C1689112018101.1689112021809 2023-07-11 21:47:02,080 DEBUG [RS:1;jenkins-hbase17:34193] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK], DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK], DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK]] 2023-07-11 21:47:02,081 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:02,085 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:47:02,121 INFO [RS:0;jenkins-hbase17:46731] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,46731,1689112018018/jenkins-hbase17.apache.org%2C46731%2C1689112018018.1689112021827 2023-07-11 21:47:02,122 INFO [RS:2;jenkins-hbase17:35055] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,35055,1689112018269/jenkins-hbase17.apache.org%2C35055%2C1689112018269.1689112021826 2023-07-11 21:47:02,128 DEBUG [RS:0;jenkins-hbase17:46731] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK], DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK], DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK]] 2023-07-11 21:47:02,141 DEBUG [RS:2;jenkins-hbase17:35055] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK], DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK], DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK]] 2023-07-11 21:47:02,145 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:47:02,184 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 21:47:02,185 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:47:02,196 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C34193%2C1689112018101.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,34193,1689112018101, archiveDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/oldWALs, maxLogs=32 2023-07-11 21:47:02,260 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK] 2023-07-11 21:47:02,264 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK] 2023-07-11 21:47:02,266 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK] 2023-07-11 21:47:02,310 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/WALs/jenkins-hbase17.apache.org,34193,1689112018101/jenkins-hbase17.apache.org%2C34193%2C1689112018101.meta.1689112022198.meta 2023-07-11 21:47:02,314 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41703,DS-5b875888-df13-4702-8be4-f785f6a1da2a,DISK], DatanodeInfoWithStorage[127.0.0.1:33695,DS-b0e69040-45fa-42b3-82fd-c05a1732e6d4,DISK], DatanodeInfoWithStorage[127.0.0.1:46083,DS-ef8315fa-0384-4735-8c3c-58f433e18950,DISK]] 2023-07-11 21:47:02,315 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:47:02,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-11 21:47:02,318 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:02,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 21:47:02,321 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 21:47:02,328 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 21:47:02,351 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 21:47:02,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:02,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 21:47:02,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 21:47:02,360 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:47:02,367 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/info 2023-07-11 21:47:02,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/info 2023-07-11 21:47:02,369 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:47:02,374 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:02,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:47:02,400 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:47:02,400 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:47:02,401 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:47:02,411 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:02,412 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:47:02,415 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/table 2023-07-11 21:47:02,415 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/table 2023-07-11 21:47:02,417 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:47:02,423 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:02,426 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740 2023-07-11 21:47:02,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740 2023-07-11 21:47:02,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 21:47:02,445 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:47:02,448 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75237056, jitterRate=0.12111949920654297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 21:47:02,451 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:47:02,477 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689112022063 2023-07-11 21:47:02,531 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 21:47:02,538 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 21:47:02,542 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,34193,1689112018101, state=OPEN 2023-07-11 21:47:02,547 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 21:47:02,548 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:47:02,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 21:47:02,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,34193,1689112018101 in 746 msec 2023-07-11 21:47:02,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 21:47:02,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.1100 sec 2023-07-11 21:47:02,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.9510 sec 2023-07-11 21:47:02,594 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689112022593, completionTime=-1 2023-07-11 21:47:02,594 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 21:47:02,594 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 21:47:02,745 DEBUG [hconnection-0x4dbc74e2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:02,762 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:02,794 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 21:47:02,795 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689112082795 2023-07-11 21:47:02,795 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689112142795 2023-07-11 21:47:02,795 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 201 msec 2023-07-11 21:47:02,845 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44551,1689112016009-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:02,846 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44551,1689112016009-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:02,846 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44551,1689112016009-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:02,849 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:44551, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:02,858 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 21:47:02,879 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 21:47:02,915 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 21:47:02,918 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:47:02,950 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 21:47:02,954 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:47:02,960 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:47:03,036 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,056 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355 empty. 2023-07-11 21:47:03,057 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,057 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 21:47:03,244 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 21:47:03,265 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d4fd312289bd134fd11c0c7009c6b355, NAME => 'hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:47:03,426 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:03,426 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d4fd312289bd134fd11c0c7009c6b355, disabling compactions & flushes 2023-07-11 21:47:03,426 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:47:03,426 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:47:03,426 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. after waiting 0 ms 2023-07-11 21:47:03,426 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:47:03,426 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:47:03,426 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d4fd312289bd134fd11c0c7009c6b355: 2023-07-11 21:47:03,436 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:47:03,476 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689112023440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112023440"}]},"ts":"1689112023440"} 2023-07-11 21:47:03,522 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:47:03,528 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:47:03,536 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112023528"}]},"ts":"1689112023528"} 2023-07-11 21:47:03,551 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 21:47:03,559 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:47:03,561 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:47:03,561 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:47:03,561 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:47:03,562 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:47:03,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d4fd312289bd134fd11c0c7009c6b355, ASSIGN}] 2023-07-11 21:47:03,570 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d4fd312289bd134fd11c0c7009c6b355, ASSIGN 2023-07-11 21:47:03,572 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d4fd312289bd134fd11c0c7009c6b355, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46731,1689112018018; forceNewPlan=false, retain=false 2023-07-11 21:47:03,725 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 21:47:03,727 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d4fd312289bd134fd11c0c7009c6b355, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:03,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689112023726"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112023726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112023726"}]},"ts":"1689112023726"} 2023-07-11 21:47:03,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d4fd312289bd134fd11c0c7009c6b355, server=jenkins-hbase17.apache.org,46731,1689112018018}] 2023-07-11 21:47:03,907 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:03,907 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:47:03,911 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:47:03,919 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:47:03,919 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d4fd312289bd134fd11c0c7009c6b355, NAME => 'hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:47:03,920 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. service=AccessControlService 2023-07-11 21:47:03,921 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:03,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:03,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,928 INFO [StoreOpener-d4fd312289bd134fd11c0c7009c6b355-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,931 DEBUG [StoreOpener-d4fd312289bd134fd11c0c7009c6b355-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355/info 2023-07-11 21:47:03,931 DEBUG [StoreOpener-d4fd312289bd134fd11c0c7009c6b355-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355/info 2023-07-11 21:47:03,932 INFO [StoreOpener-d4fd312289bd134fd11c0c7009c6b355-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4fd312289bd134fd11c0c7009c6b355 columnFamilyName info 2023-07-11 21:47:03,936 INFO [StoreOpener-d4fd312289bd134fd11c0c7009c6b355-1] regionserver.HStore(310): Store=d4fd312289bd134fd11c0c7009c6b355/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:03,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:47:03,956 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:47:03,957 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened d4fd312289bd134fd11c0c7009c6b355; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66044810, jitterRate=-0.015855640172958374}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:47:03,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for d4fd312289bd134fd11c0c7009c6b355: 2023-07-11 21:47:03,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355., pid=6, masterSystemTime=1689112023907 2023-07-11 21:47:03,967 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:47:03,968 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:47:03,971 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d4fd312289bd134fd11c0c7009c6b355, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:03,971 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689112023970"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112023970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112023970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112023970"}]},"ts":"1689112023970"} 2023-07-11 21:47:03,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 21:47:03,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d4fd312289bd134fd11c0c7009c6b355, server=jenkins-hbase17.apache.org,46731,1689112018018 in 235 msec 2023-07-11 21:47:03,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 21:47:03,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d4fd312289bd134fd11c0c7009c6b355, ASSIGN in 415 msec 2023-07-11 21:47:03,991 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:47:03,991 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112023991"}]},"ts":"1689112023991"} 2023-07-11 21:47:03,996 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 21:47:04,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:47:04,006 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 21:47:04,008 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:47:04,008 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:47:04,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.0820 sec 2023-07-11 21:47:04,058 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:04,072 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:04,099 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 21:47:04,212 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:47:04,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 131 msec 2023-07-11 21:47:04,230 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 21:47:04,249 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:47:04,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 26 msec 2023-07-11 21:47:04,290 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 5.791sec 2023-07-11 21:47:04,291 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 21:47:04,291 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 21:47:04,306 DEBUG [Listener at localhost.localdomain/45553] zookeeper.ReadOnlyZKClient(139): Connect 0x33fbac76 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:04,310 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 21:47:04,312 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 21:47:04,312 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 21:47:04,317 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44551,1689112016009-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 21:47:04,318 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44551,1689112016009-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 21:47:04,367 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:47:04,374 DEBUG [Listener at localhost.localdomain/45553] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70bc6a4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:04,376 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-11 21:47:04,380 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:47:04,394 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:47:04,400 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-11 21:47:04,411 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:04,412 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc empty. 2023-07-11 21:47:04,416 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:04,416 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-11 21:47:04,417 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:47:04,462 DEBUG [hconnection-0x5a7b3011-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:04,490 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:04,496 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:47:04,496 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-11 21:47:04,496 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/test.cache.data in system properties and HBase conf 2023-07-11 21:47:04,496 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 21:47:04,496 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop.log.dir in system properties and HBase conf 2023-07-11 21:47:04,496 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 21:47:04,496 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 21:47:04,496 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:47:04,497 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 21:47:04,498 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/nfs.dump.dir in system properties and HBase conf 2023-07-11 21:47:04,498 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir in system properties and HBase conf 2023-07-11 21:47:04,498 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:47:04,498 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 21:47:04,498 INFO [Listener at localhost.localdomain/45553] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-11 21:47:04,530 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:47:04,543 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-11 21:47:04,551 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => b9a6bdc4bb71f39b337a61f8253a86fc, NAME => 'hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:47:04,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:04,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing b9a6bdc4bb71f39b337a61f8253a86fc, disabling compactions & flushes 2023-07-11 21:47:04,685 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:47:04,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:47:04,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. after waiting 0 ms 2023-07-11 21:47:04,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:47:04,685 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:47:04,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for b9a6bdc4bb71f39b337a61f8253a86fc: 2023-07-11 21:47:04,697 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:47:04,700 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689112024700"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112024700"}]},"ts":"1689112024700"} 2023-07-11 21:47:04,708 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:47:04,715 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:47:04,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112024715"}]},"ts":"1689112024715"} 2023-07-11 21:47:04,720 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-11 21:47:04,727 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:47:04,729 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:47:04,729 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:47:04,730 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:47:04,730 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:47:04,730 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:47:04,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b9a6bdc4bb71f39b337a61f8253a86fc, ASSIGN}] 2023-07-11 21:47:04,737 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b9a6bdc4bb71f39b337a61f8253a86fc, ASSIGN 2023-07-11 21:47:04,743 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=b9a6bdc4bb71f39b337a61f8253a86fc, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35055,1689112018269; forceNewPlan=false, retain=false 2023-07-11 21:47:04,893 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 21:47:04,903 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b9a6bdc4bb71f39b337a61f8253a86fc, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:04,903 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689112024903"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112024903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112024903"}]},"ts":"1689112024903"} 2023-07-11 21:47:04,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure b9a6bdc4bb71f39b337a61f8253a86fc, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:47:05,030 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:47:05,066 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:05,066 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:47:05,069 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:47:05,113 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:47:05,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9a6bdc4bb71f39b337a61f8253a86fc, NAME => 'hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:47:05,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. service=AccessControlService 2023-07-11 21:47:05,114 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:05,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:05,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:05,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:05,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:05,118 INFO [StoreOpener-b9a6bdc4bb71f39b337a61f8253a86fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:05,123 DEBUG [StoreOpener-b9a6bdc4bb71f39b337a61f8253a86fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc/l 2023-07-11 21:47:05,123 DEBUG [StoreOpener-b9a6bdc4bb71f39b337a61f8253a86fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc/l 2023-07-11 21:47:05,124 INFO [StoreOpener-b9a6bdc4bb71f39b337a61f8253a86fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9a6bdc4bb71f39b337a61f8253a86fc columnFamilyName l 2023-07-11 21:47:05,125 INFO [StoreOpener-b9a6bdc4bb71f39b337a61f8253a86fc-1] regionserver.HStore(310): Store=b9a6bdc4bb71f39b337a61f8253a86fc/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:05,129 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:05,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:05,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:47:05,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:47:05,203 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b9a6bdc4bb71f39b337a61f8253a86fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60857832, jitterRate=-0.0931476354598999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:47:05,203 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b9a6bdc4bb71f39b337a61f8253a86fc: 2023-07-11 21:47:05,241 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc., pid=11, masterSystemTime=1689112025066 2023-07-11 21:47:05,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:47:05,253 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:47:05,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b9a6bdc4bb71f39b337a61f8253a86fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:05,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689112025254"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112025254"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112025254"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112025254"}]},"ts":"1689112025254"} 2023-07-11 21:47:05,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 21:47:05,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure b9a6bdc4bb71f39b337a61f8253a86fc, server=jenkins-hbase17.apache.org,35055,1689112018269 in 355 msec 2023-07-11 21:47:05,279 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 21:47:05,279 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=b9a6bdc4bb71f39b337a61f8253a86fc, ASSIGN in 542 msec 2023-07-11 21:47:05,285 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:47:05,286 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112025286"}]},"ts":"1689112025286"} 2023-07-11 21:47:05,289 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-11 21:47:05,293 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:47:05,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 926 msec 2023-07-11 21:47:05,531 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:47:05,531 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-11 21:47:05,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 21:47:06,216 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:47:06,216 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-11 21:47:06,217 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:47:06,217 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-11 21:47:06,217 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 21:47:06,217 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-11 21:47:06,217 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:47:06,217 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-11 21:47:06,218 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:47:06,218 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 21:47:07,184 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 21:47:07,186 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 21:47:07,189 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-11 21:47:07,973 WARN [Listener at localhost.localdomain/45553] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-nodemanager.properties,hadoop-metrics2.properties 2023-07-11 21:47:08,603 WARN [Thread-385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:47:09,120 INFO [Thread-385] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:47:09,135 INFO [Thread-385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_45353_jobhistory____.kkt92z/webapp 2023-07-11 21:47:09,366 INFO [Thread-385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-11 21:47:09,366 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-11 21:47:09,366 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 21:47:09,369 INFO [Thread-385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 21:47:09,450 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:09,917 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:10,738 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-11 21:47:10,819 INFO [Thread-385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:45353 2023-07-11 21:47:11,578 WARN [Listener at jenkins-hbase17.apache.org/43985] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:47:11,789 WARN [Listener at jenkins-hbase17.apache.org/43985] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 21:47:11,790 INFO [Listener at jenkins-hbase17.apache.org/43985] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:47:11,821 INFO [Listener at jenkins-hbase17.apache.org/43985] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_46671_cluster____.njhgye/webapp 2023-07-11 21:47:12,015 INFO [Listener at jenkins-hbase17.apache.org/43985] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 21:47:12,016 INFO [Listener at jenkins-hbase17.apache.org/43985] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-11 21:47:12,016 INFO [Listener at jenkins-hbase17.apache.org/43985] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 21:47:12,017 INFO [Listener at jenkins-hbase17.apache.org/43985] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 21:47:12,053 INFO [Listener at jenkins-hbase17.apache.org/43985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:12,643 INFO [Listener at jenkins-hbase17.apache.org/43985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:12,887 INFO [Listener at jenkins-hbase17.apache.org/43985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:12,897 INFO [Listener at jenkins-hbase17.apache.org/43985] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:46671 2023-07-11 21:47:14,387 WARN [Listener at jenkins-hbase17.apache.org/37919] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:47:14,426 WARN [Listener at jenkins-hbase17.apache.org/37919] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 21:47:14,427 INFO [Listener at jenkins-hbase17.apache.org/37919] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:47:14,436 INFO [Listener at jenkins-hbase17.apache.org/37919] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_39421_node____.5uu289/webapp 2023-07-11 21:47:14,499 INFO [Listener at jenkins-hbase17.apache.org/37919] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 21:47:14,499 INFO [Listener at jenkins-hbase17.apache.org/37919] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 21:47:14,500 INFO [Listener at jenkins-hbase17.apache.org/37919] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 21:47:14,500 INFO [Listener at jenkins-hbase17.apache.org/37919] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 21:47:14,515 INFO [Listener at jenkins-hbase17.apache.org/37919] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:14,555 INFO [Listener at jenkins-hbase17.apache.org/37919] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:14,788 INFO [Listener at jenkins-hbase17.apache.org/37919] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:14,835 INFO [Listener at jenkins-hbase17.apache.org/37919] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:39421 2023-07-11 21:47:15,686 WARN [Listener at jenkins-hbase17.apache.org/33347] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:47:15,697 WARN [Listener at jenkins-hbase17.apache.org/33347] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 21:47:15,697 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:47:15,707 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_38263_node____.lc6ur0/webapp 2023-07-11 21:47:15,763 INFO [Listener at jenkins-hbase17.apache.org/33347] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 21:47:15,763 INFO [Listener at jenkins-hbase17.apache.org/33347] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 21:47:15,763 INFO [Listener at jenkins-hbase17.apache.org/33347] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 21:47:15,763 INFO [Listener at jenkins-hbase17.apache.org/33347] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 21:47:15,776 INFO [Listener at jenkins-hbase17.apache.org/33347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:15,786 INFO [Listener at jenkins-hbase17.apache.org/33347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:15,890 INFO [Listener at jenkins-hbase17.apache.org/33347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:47:15,912 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:38263 2023-07-11 21:47:15,989 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-11 21:47:15,991 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:47:16,118 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=877, MaxFileDescriptor=60000, SystemLoadAverage=969, ProcessCount=188, AvailableMemoryMB=3217 2023-07-11 21:47:16,118 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-11 21:47:16,138 DEBUG [Listener at jenkins-hbase17.apache.org/33347] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 21:47:16,154 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 21:47:16,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 21:47:16,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:47:16,174 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:47:16,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-11 21:47:16,180 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:47:16,186 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,186 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:47:16,187 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677 empty. 2023-07-11 21:47:16,187 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0 empty. 2023-07-11 21:47:16,188 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,197 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,197 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 21:47:16,257 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-11 21:47:16,259 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => af0234591a6080afea9db40b3f916677, NAME => 'testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:47:16,260 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => c3ed268b32d70da76816ce8a6e3b9bd0, NAME => 'testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:47:16,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:47:16,379 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:16,384 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing c3ed268b32d70da76816ce8a6e3b9bd0, disabling compactions & flushes 2023-07-11 21:47:16,384 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:16,384 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:16,384 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. after waiting 0 ms 2023-07-11 21:47:16,384 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:16,384 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:16,384 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for c3ed268b32d70da76816ce8a6e3b9bd0: 2023-07-11 21:47:16,397 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:16,398 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing af0234591a6080afea9db40b3f916677, disabling compactions & flushes 2023-07-11 21:47:16,399 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:16,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:16,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. after waiting 0 ms 2023-07-11 21:47:16,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:16,399 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:16,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for af0234591a6080afea9db40b3f916677: 2023-07-11 21:47:16,404 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:47:16,405 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112036405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112036405"}]},"ts":"1689112036405"} 2023-07-11 21:47:16,406 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112036405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112036405"}]},"ts":"1689112036405"} 2023-07-11 21:47:16,465 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:47:16,467 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:47:16,468 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112036467"}]},"ts":"1689112036467"} 2023-07-11 21:47:16,470 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-11 21:47:16,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:47:16,478 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:47:16,478 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:47:16,478 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:47:16,478 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:47:16,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=af0234591a6080afea9db40b3f916677, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3ed268b32d70da76816ce8a6e3b9bd0, ASSIGN}] 2023-07-11 21:47:16,483 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=af0234591a6080afea9db40b3f916677, ASSIGN 2023-07-11 21:47:16,483 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3ed268b32d70da76816ce8a6e3b9bd0, ASSIGN 2023-07-11 21:47:16,485 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=af0234591a6080afea9db40b3f916677, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35055,1689112018269; forceNewPlan=false, retain=false 2023-07-11 21:47:16,485 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3ed268b32d70da76816ce8a6e3b9bd0, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34193,1689112018101; forceNewPlan=false, retain=false 2023-07-11 21:47:16,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:47:16,636 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:47:16,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c3ed268b32d70da76816ce8a6e3b9bd0, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:16,638 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=af0234591a6080afea9db40b3f916677, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:16,639 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112036638"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112036638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112036638"}]},"ts":"1689112036638"} 2023-07-11 21:47:16,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112036638"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112036638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112036638"}]},"ts":"1689112036638"} 2023-07-11 21:47:16,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure c3ed268b32d70da76816ce8a6e3b9bd0, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:47:16,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure af0234591a6080afea9db40b3f916677, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:47:16,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:47:16,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:16,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3ed268b32d70da76816ce8a6e3b9bd0, NAME => 'testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:47:16,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. service=AccessControlService 2023-07-11 21:47:16,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:16,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:16,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,842 INFO [StoreOpener-c3ed268b32d70da76816ce8a6e3b9bd0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:16,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af0234591a6080afea9db40b3f916677, NAME => 'testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:47:16,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. service=AccessControlService 2023-07-11 21:47:16,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:16,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:16,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,857 DEBUG [StoreOpener-c3ed268b32d70da76816ce8a6e3b9bd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf 2023-07-11 21:47:16,857 DEBUG [StoreOpener-c3ed268b32d70da76816ce8a6e3b9bd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf 2023-07-11 21:47:16,861 INFO [StoreOpener-af0234591a6080afea9db40b3f916677-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,862 INFO [StoreOpener-c3ed268b32d70da76816ce8a6e3b9bd0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3ed268b32d70da76816ce8a6e3b9bd0 columnFamilyName cf 2023-07-11 21:47:16,864 DEBUG [StoreOpener-af0234591a6080afea9db40b3f916677-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf 2023-07-11 21:47:16,864 DEBUG [StoreOpener-af0234591a6080afea9db40b3f916677-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf 2023-07-11 21:47:16,864 INFO [StoreOpener-af0234591a6080afea9db40b3f916677-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af0234591a6080afea9db40b3f916677 columnFamilyName cf 2023-07-11 21:47:16,866 INFO [StoreOpener-c3ed268b32d70da76816ce8a6e3b9bd0-1] regionserver.HStore(310): Store=c3ed268b32d70da76816ce8a6e3b9bd0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:16,867 INFO [StoreOpener-af0234591a6080afea9db40b3f916677-1] regionserver.HStore(310): Store=af0234591a6080afea9db40b3f916677/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:16,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:16,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for af0234591a6080afea9db40b3f916677 2023-07-11 21:47:16,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:47:16,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:47:16,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened c3ed268b32d70da76816ce8a6e3b9bd0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66036408, jitterRate=-0.015980839729309082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:47:16,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for c3ed268b32d70da76816ce8a6e3b9bd0: 2023-07-11 21:47:16,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0., pid=15, masterSystemTime=1689112036798 2023-07-11 21:47:16,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened af0234591a6080afea9db40b3f916677; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73446610, jitterRate=0.09443977475166321}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:47:16,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for af0234591a6080afea9db40b3f916677: 2023-07-11 21:47:16,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677., pid=16, masterSystemTime=1689112036801 2023-07-11 21:47:16,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:16,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:16,909 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c3ed268b32d70da76816ce8a6e3b9bd0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:16,909 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112036909"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112036909"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112036909"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112036909"}]},"ts":"1689112036909"} 2023-07-11 21:47:16,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:16,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:16,910 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=af0234591a6080afea9db40b3f916677, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:16,911 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112036910"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112036910"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112036910"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112036910"}]},"ts":"1689112036910"} 2023-07-11 21:47:16,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-11 21:47:16,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure c3ed268b32d70da76816ce8a6e3b9bd0, server=jenkins-hbase17.apache.org,34193,1689112018101 in 270 msec 2023-07-11 21:47:16,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-11 21:47:16,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure af0234591a6080afea9db40b3f916677, server=jenkins-hbase17.apache.org,35055,1689112018269 in 270 msec 2023-07-11 21:47:16,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3ed268b32d70da76816ce8a6e3b9bd0, ASSIGN in 440 msec 2023-07-11 21:47:16,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-11 21:47:16,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=af0234591a6080afea9db40b3f916677, ASSIGN in 441 msec 2023-07-11 21:47:16,927 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:47:16,927 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112036927"}]},"ts":"1689112036927"} 2023-07-11 21:47:16,930 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-11 21:47:16,933 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:47:16,940 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-11 21:47:16,969 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:16,974 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:16,978 DEBUG [hconnection-0x29d1215d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:16,982 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-11 21:47:16,991 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 21:47:17,020 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:17,020 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:17,020 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:17,020 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:17,020 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:47:17,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 21:47:17,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 21:47:17,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 21:47:17,029 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 21:47:17,033 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 862 msec 2023-07-11 21:47:17,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:47:17,306 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-11 21:47:17,312 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-11 21:47:17,313 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:17,317 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:47:17,348 DEBUG [hconnection-0x5a7b3011-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:17,353 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:17,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:47:17,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112037377 (current time:1689112037377). 2023-07-11 21:47:17,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:47:17,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x066987de to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:17,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35a5141b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:17,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:17,393 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:17,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x066987de to 127.0.0.1:59736 2023-07-11 21:47:17,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:47:17,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x35e1ce06 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:17,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@534e97c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:17,405 DEBUG [hconnection-0x1018eee5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:17,406 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:17,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:17,413 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:17,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35e1ce06 to 127.0.0.1:59736 2023-07-11 21:47:17,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:47:17,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 21:47:17,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:47:17,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:47:17,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:47:17,467 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:47:17,469 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689112637469 2023-07-11 21:47:17,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:47:17,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 21:47:17,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:47:17,475 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:47:17,480 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:47:17,480 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:47:17,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-07-11 21:47:17,483 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:47:17,487 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689112637487 2023-07-11 21:47:17,582 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:17,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:47:17,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:17,590 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:47:17,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,644 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-11 21:47:17,644 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:17,645 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 21:47:17,645 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 21:47:17,647 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,647 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,649 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:17,649 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:17,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:17,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:17,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:17,649 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:17,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:17,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:17,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:17,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 21:47:17,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 21:47:17,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,654 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:47:17,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 21:47:17,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:47:17,655 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,656 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,656 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,654 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:47:17,657 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,657 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:47:17,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,661 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:47:17,661 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:17,663 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:47:17,663 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:47:17,663 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 21:47:17,667 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,667 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:17,668 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:47:17,668 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:17,672 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:47:17,672 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:47:17,672 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 21:47:17,675 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,677 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,677 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:17,684 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:47:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,684 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:17,687 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,687 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,689 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:47:17,689 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:47:17,689 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 21:47:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:17,692 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 21:47:17,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61c0b6d4[Count = 1] remaining members to acquire global barrier 2023-07-11 21:47:17,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:17,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:17,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 21:47:17,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61c0b6d4[Count = 0] remaining members to acquire global barrier 2023-07-11 21:47:17,697 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 21:47:17,697 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,699 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,700 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,700 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,700 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:47:17,700 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,700 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,701 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,701 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:17,701 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:47:17,700 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:47:17,701 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,702 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 21:47:17,702 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:47:17,702 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:47:17,707 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:47:17,707 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:17,707 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:47:17,710 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. started... 2023-07-11 21:47:17,711 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:47:17,711 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:17,711 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 21:47:17,715 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:17,732 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. started... 2023-07-11 21:47:17,715 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:47:17,732 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:47:17,732 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3ed268b32d70da76816ce8a6e3b9bd0: 2023-07-11 21:47:17,734 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,736 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af0234591a6080afea9db40b3f916677: 2023-07-11 21:47:17,737 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,744 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:47:17,746 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:47:17,752 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:47:17,753 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:47:17,790 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:17,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:47:17,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:17,793 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:47:17,838 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. completed. 2023-07-11 21:47:17,838 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:17,838 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:47:17,838 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:47:17,839 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,839 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 21:47:17,839 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:47:17,840 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. completed. 2023-07-11 21:47:17,840 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:17,840 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:47:17,840 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:47:17,840 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:17,840 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,840 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 21:47:17,840 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:47:17,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:17,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:17,842 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,842 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 21:47:17,842 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:47:17,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:17,843 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,843 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:47:17,844 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:17,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:17,844 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 21:47:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:47:17,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 21:47:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:47:17,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 21:47:17,853 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-11 21:47:17,853 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:47:17,853 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:47:17,853 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,853 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:47:17,855 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,855 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:17,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,855 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,855 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,856 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:17,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,855 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,855 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:17,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:17,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:17,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:17,856 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,857 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,857 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:17,859 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,860 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,860 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,879 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,879 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:17,879 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:17,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:17,879 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:17,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:17,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-11 21:47:17,879 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:17,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:17,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,879 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:47:17,879 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:17,879 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,881 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:17,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:17,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:17,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:17,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:17,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:17,879 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:17,881 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,882 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,882 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:17,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:17,882 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:17,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:17,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:17,882 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,882 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:17,882 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:17,882 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,882 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 21:47:17,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:17,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:18,005 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 21:47:18,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:18,006 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:18,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689112037469Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689112037903 (+434 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689112037903Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689112037904 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689112037916 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689112037943 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689112038005 (+62 ms) 2023-07-11 21:47:18,009 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:47:18,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 537 msec 2023-07-11 21:47:18,093 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:18,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:47:18,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:47:18,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35055] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:47:18,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34193] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:47:18,119 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-11 21:47:18,119 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:18,120 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:47:18,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:47:18,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112038138 (current time:1689112038138). 2023-07-11 21:47:18,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:47:18,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x52576346 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:18,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@639bf780, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:18,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:18,148 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:18,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52576346 to 127.0.0.1:59736 2023-07-11 21:47:18,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:47:18,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x4b119311 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:18,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22b58466, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:18,158 DEBUG [hconnection-0x1e2e4047-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:18,161 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:18,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:18,172 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:18,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b119311 to 127.0.0.1:59736 2023-07-11 21:47:18,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:47:18,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 21:47:18,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:47:18,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:47:18,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:47:18,180 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:47:18,181 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689112638181 2023-07-11 21:47:18,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 21:47:18,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:47:18,183 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:47:18,184 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:47:18,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:47:18,190 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:47:18,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-11 21:47:18,194 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:47:18,196 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689112638196 2023-07-11 21:47:18,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-11 21:47:18,242 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-11 21:47:18,242 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:18,244 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 21:47:18,244 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 21:47:18,244 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,244 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,245 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:18,245 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:18,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:18,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:18,245 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,245 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:18,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,246 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,246 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,246 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:18,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,246 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:47:18,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 21:47:18,247 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,247 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:18,247 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:47:18,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 21:47:18,250 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:47:18,250 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:47:18,250 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:47:18,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 21:47:18,250 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 21:47:18,250 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:18,250 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:47:18,251 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:47:18,251 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:47:18,251 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:18,251 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 21:47:18,252 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:47:18,252 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:47:18,252 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 21:47:18,257 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,257 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:18,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:18,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:18,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:18,257 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,258 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,259 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:18,259 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:18,259 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,259 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,259 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:18,259 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,259 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:18,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:18,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:18,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:18,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:18,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 21:47:18,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4049edfe[Count = 1] remaining members to acquire global barrier 2023-07-11 21:47:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:18,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:18,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:18,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:18,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 21:47:18,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4049edfe[Count = 0] remaining members to acquire global barrier 2023-07-11 21:47:18,264 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 21:47:18,264 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,267 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,267 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,268 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:47:18,268 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:47:18,268 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 21:47:18,268 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:47:18,268 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:18,268 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:18,268 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. started... 2023-07-11 21:47:18,268 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,268 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:47:18,269 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:47:18,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:18,268 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,269 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:47:18,269 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing af0234591a6080afea9db40b3f916677 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-11 21:47:18,269 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:47:18,273 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:47:18,273 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:47:18,274 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:18,274 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. started... 2023-07-11 21:47:18,274 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:47:18,274 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:18,274 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 21:47:18,278 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c3ed268b32d70da76816ce8a6e3b9bd0 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-11 21:47:18,284 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:18,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:47:18,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:18,286 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:47:18,486 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:18,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:47:18,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:18,488 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:47:18,516 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307119ff19c02ca6746bcb4d9d86a264fd0ef to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307119ff19c02ca6746bcb4d9d86a264fd0ef 2023-07-11 21:47:18,553 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/.tmp/cf/c33420a0598a4c8aad3a4f3d683c1980 2023-07-11 21:47:18,572 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/.tmp/cf/c33420a0598a4c8aad3a4f3d683c1980 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf/c33420a0598a4c8aad3a4f3d683c1980 2023-07-11 21:47:18,582 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf/c33420a0598a4c8aad3a4f3d683c1980, entries=44, sequenceid=6, filesize=12.3 K 2023-07-11 21:47:18,585 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for c3ed268b32d70da76816ce8a6e3b9bd0 in 310ms, sequenceid=6, compaction requested=false 2023-07-11 21:47:18,585 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-11 21:47:18,585 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3ed268b32d70da76816ce8a6e3b9bd0: 2023-07-11 21:47:18,586 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:47:18,586 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:47:18,586 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf/c33420a0598a4c8aad3a4f3d683c1980] hfiles 2023-07-11 21:47:18,586 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf/c33420a0598a4c8aad3a4f3d683c1980 for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:47:18,606 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. completed. 2023-07-11 21:47:18,606 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:18,606 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:47:18,608 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:47:18,608 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,608 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 21:47:18,608 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:47:18,610 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,610 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:47:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:18,610 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:18,610 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 21:47:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:18,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:18,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:47:18,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 21:47:18,789 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:18,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:47:18,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:18,790 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:47:18,877 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071109daf406216b49b28dc1376c4859bd56 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071109daf406216b49b28dc1376c4859bd56 2023-07-11 21:47:18,917 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/.tmp/cf/6b1f56c070654a9c8186e66bb9e17ca5 2023-07-11 21:47:18,933 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/.tmp/cf/6b1f56c070654a9c8186e66bb9e17ca5 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf/6b1f56c070654a9c8186e66bb9e17ca5 2023-07-11 21:47:18,955 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf/6b1f56c070654a9c8186e66bb9e17ca5, entries=6, sequenceid=6, filesize=5.9 K 2023-07-11 21:47:18,958 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for af0234591a6080afea9db40b3f916677 in 689ms, sequenceid=6, compaction requested=false 2023-07-11 21:47:18,960 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af0234591a6080afea9db40b3f916677: 2023-07-11 21:47:18,960 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:47:18,961 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:47:18,961 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf/6b1f56c070654a9c8186e66bb9e17ca5] hfiles 2023-07-11 21:47:18,961 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf/6b1f56c070654a9c8186e66bb9e17ca5 for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:47:19,004 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. completed. 2023-07-11 21:47:19,004 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:19,004 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:47:19,005 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:47:19,005 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,005 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 21:47:19,005 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:47:19,019 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,019 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:47:19,019 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:19,019 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 21:47:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:19,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:47:19,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 21:47:19,025 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-11 21:47:19,025 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:47:19,025 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:47:19,025 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-11 21:47:19,025 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:47:19,027 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:19,027 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:19,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,027 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:19,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:19,030 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,031 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:19,031 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:19,033 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:47:19,034 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:19,034 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,049 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:19,049 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:19,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:19,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:19,049 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-11 21:47:19,049 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:19,049 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-11 21:47:19,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:19,049 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:19,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:47:19,049 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:19,049 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:19,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:47:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:19,049 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,049 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:19,051 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:19,051 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:19,051 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:19,051 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,051 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:19,052 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,052 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:19,052 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:19,052 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,052 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:19,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:19,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:19,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:19,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:19,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:19,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307119ff19c02ca6746bcb4d9d86a264fd0ef, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071109daf406216b49b28dc1376c4859bd56] mob files 2023-07-11 21:47:19,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307119ff19c02ca6746bcb4d9d86a264fd0ef 2023-07-11 21:47:19,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071109daf406216b49b28dc1376c4859bd56 2023-07-11 21:47:19,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-11 21:47:19,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 21:47:19,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,171 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 21:47:19,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689112038182Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689112039097 (+915 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689112039097Loading Region manifests for snaptb0-testExportWithTargetName at 1689112039097Writing data manifest for snaptb0-testExportWithTargetName at 1689112039104 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689112039121 (+17 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689112039170 (+49 ms) 2023-07-11 21:47:19,173 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:47:19,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 991 msec 2023-07-11 21:47:19,290 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:19,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:47:19,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:47:19,295 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295 2023-07-11 21:47:19,296 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:37147, tgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295, rawTgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295, srcFsUri=hdfs://localhost.localdomain:37147, srcDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:47:19,365 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:47:19,365 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2005475376_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 21:47:19,365 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e, snapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-11 21:47:19,414 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 21:47:19,660 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:19,661 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:19,662 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:19,662 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,087 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-1165773189025006823.jar 2023-07-11 21:47:22,088 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,089 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,230 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-4773807186963723825.jar 2023-07-11 21:47:22,231 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,231 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,232 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,232 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,233 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,233 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:22,234 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:47:22,234 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:47:22,235 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:47:22,235 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:47:22,236 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:47:22,236 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:47:22,237 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:47:22,237 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:47:22,238 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:47:22,238 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:47:22,242 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:47:22,242 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:47:22,243 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:47:22,243 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:47:22,243 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:47:22,244 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:47:22,245 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:47:22,718 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:47:24,602 WARN [Listener at jenkins-hbase17.apache.org/33347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:47:24,609 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-11 21:47:24,619 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-11 21:47:25,220 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:47:25,221 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:47:25,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0001_000001 (auth:SIMPLE) 2023-07-11 21:47:35,977 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0001_000001 (auth:SIMPLE) 2023-07-11 21:47:38,421 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0001_000001 (auth:SIMPLE) 2023-07-11 21:47:42,331 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0001_000001 (auth:SIMPLE) 2023-07-11 21:47:43,683 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:47:43,685 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:47:43,694 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-11 21:47:43,694 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:47:43,696 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:47:43,696 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 21:47:43,697 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-11 21:47:43,697 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-11 21:47:43,697 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295/.hbase-snapshot/testExportWithTargetName at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295/.hbase-snapshot/testExportWithTargetName 2023-07-11 21:47:43,698 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-11 21:47:43,698 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112039295/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-11 21:47:43,711 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-11 21:47:43,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-07-11 21:47:43,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:47:43,729 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112063729"}]},"ts":"1689112063729"} 2023-07-11 21:47:43,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 21:47:43,731 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-11 21:47:43,733 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-11 21:47:43,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=af0234591a6080afea9db40b3f916677, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3ed268b32d70da76816ce8a6e3b9bd0, UNASSIGN}] 2023-07-11 21:47:43,737 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3ed268b32d70da76816ce8a6e3b9bd0, UNASSIGN 2023-07-11 21:47:43,737 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=af0234591a6080afea9db40b3f916677, UNASSIGN 2023-07-11 21:47:43,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c3ed268b32d70da76816ce8a6e3b9bd0, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:43,738 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=af0234591a6080afea9db40b3f916677, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:43,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112063738"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112063738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112063738"}]},"ts":"1689112063738"} 2023-07-11 21:47:43,738 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112063738"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112063738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112063738"}]},"ts":"1689112063738"} 2023-07-11 21:47:43,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure af0234591a6080afea9db40b3f916677, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:47:43,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure c3ed268b32d70da76816ce8a6e3b9bd0, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:47:43,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 21:47:43,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:43,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close af0234591a6080afea9db40b3f916677 2023-07-11 21:47:43,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing c3ed268b32d70da76816ce8a6e3b9bd0, disabling compactions & flushes 2023-07-11 21:47:43,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing af0234591a6080afea9db40b3f916677, disabling compactions & flushes 2023-07-11 21:47:43,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:43,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. after waiting 0 ms 2023-07-11 21:47:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. after waiting 0 ms 2023-07-11 21:47:43,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:43,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:47:43,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:47:43,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0. 2023-07-11 21:47:43,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for c3ed268b32d70da76816ce8a6e3b9bd0: 2023-07-11 21:47:43,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:47:43,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:47:43,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677. 2023-07-11 21:47:43,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for af0234591a6080afea9db40b3f916677: 2023-07-11 21:47:43,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:43,950 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c3ed268b32d70da76816ce8a6e3b9bd0, regionState=CLOSED 2023-07-11 21:47:43,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed af0234591a6080afea9db40b3f916677 2023-07-11 21:47:43,950 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112063950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112063950"}]},"ts":"1689112063950"} 2023-07-11 21:47:43,951 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=af0234591a6080afea9db40b3f916677, regionState=CLOSED 2023-07-11 21:47:43,952 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112063951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112063951"}]},"ts":"1689112063951"} 2023-07-11 21:47:43,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-11 21:47:43,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure c3ed268b32d70da76816ce8a6e3b9bd0, server=jenkins-hbase17.apache.org,34193,1689112018101 in 212 msec 2023-07-11 21:47:43,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-11 21:47:43,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure af0234591a6080afea9db40b3f916677, server=jenkins-hbase17.apache.org,35055,1689112018269 in 214 msec 2023-07-11 21:47:43,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3ed268b32d70da76816ce8a6e3b9bd0, UNASSIGN in 222 msec 2023-07-11 21:47:43,963 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-11 21:47:43,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=af0234591a6080afea9db40b3f916677, UNASSIGN in 225 msec 2023-07-11 21:47:43,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112063966"}]},"ts":"1689112063966"} 2023-07-11 21:47:43,969 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-11 21:47:43,970 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-11 21:47:43,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 252 msec 2023-07-11 21:47:44,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 21:47:44,033 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-11 21:47:44,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-07-11 21:47:44,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:47:44,050 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:47:44,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-11 21:47:44,052 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:47:44,055 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-11 21:47:44,057 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:47:44,057 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:47:44,057 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:47:44,059 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:47:44,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 21:47:44,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 21:47:44,059 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677 2023-07-11 21:47:44,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 21:47:44,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 21:47:44,059 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:44,061 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:47:44,061 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:44,061 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:47:44,061 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:47:44,061 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:44,061 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:47:44,062 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:44,061 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:44,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 21:47:44,080 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/recovered.edits] 2023-07-11 21:47:44,080 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/recovered.edits] 2023-07-11 21:47:44,099 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf/c33420a0598a4c8aad3a4f3d683c1980 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/cf/c33420a0598a4c8aad3a4f3d683c1980 2023-07-11 21:47:44,099 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf/6b1f56c070654a9c8186e66bb9e17ca5 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/cf/6b1f56c070654a9c8186e66bb9e17ca5 2023-07-11 21:47:44,113 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677/recovered.edits/9.seqid 2023-07-11 21:47:44,113 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0/recovered.edits/9.seqid 2023-07-11 21:47:44,116 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/af0234591a6080afea9db40b3f916677 2023-07-11 21:47:44,116 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportWithTargetName/c3ed268b32d70da76816ce8a6e3b9bd0 2023-07-11 21:47:44,116 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 21:47:44,117 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-11 21:47:44,119 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-11 21:47:44,124 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307119ff19c02ca6746bcb4d9d86a264fd0ef to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307119ff19c02ca6746bcb4d9d86a264fd0ef 2023-07-11 21:47:44,129 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071109daf406216b49b28dc1376c4859bd56 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071109daf406216b49b28dc1376c4859bd56 2023-07-11 21:47:44,130 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-11 21:47:44,138 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:47:44,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 21:47:44,178 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-11 21:47:44,191 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-11 21:47:44,194 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:47:44,194 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-11 21:47:44,194 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112064194"}]},"ts":"9223372036854775807"} 2023-07-11 21:47:44,194 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112064194"}]},"ts":"9223372036854775807"} 2023-07-11 21:47:44,203 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 21:47:44,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => af0234591a6080afea9db40b3f916677, NAME => 'testtb-testExportWithTargetName,,1689112036165.af0234591a6080afea9db40b3f916677.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c3ed268b32d70da76816ce8a6e3b9bd0, NAME => 'testtb-testExportWithTargetName,1,1689112036165.c3ed268b32d70da76816ce8a6e3b9bd0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 21:47:44,203 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-11 21:47:44,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112064203"}]},"ts":"9223372036854775807"} 2023-07-11 21:47:44,215 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-11 21:47:44,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:47:44,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 178 msec 2023-07-11 21:47:44,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 21:47:44,376 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-11 21:47:44,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-11 21:47:44,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-11 21:47:44,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-07-11 21:47:44,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-11 21:47:44,461 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=749 (was 704) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:41970 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to jenkins-hbase17.apache.org/136.243.18.41:45785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to jenkins-hbase17.apache.org/136.243.18.41:43251 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-395465281_1 at /127.0.0.1:41934 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1320 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:48698 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to localhost.localdomain/127.0.0.1:37147 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to localhost.localdomain/127.0.0.1:37147 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-395465281_1 at /127.0.0.1:48682 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 877) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=988 (was 969) - SystemLoadAverage LEAK? -, ProcessCount=189 (was 188) - ProcessCount LEAK? -, AvailableMemoryMB=2643 (was 3217) 2023-07-11 21:47:44,461 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-11 21:47:44,491 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=749, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=988, ProcessCount=189, AvailableMemoryMB=2642 2023-07-11 21:47:44,491 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-11 21:47:44,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 21:47:44,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:47:44,503 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:47:44,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-11 21:47:44,507 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:47:44,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 21:47:44,510 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,511 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee empty. 2023-07-11 21:47:44,511 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,511 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,511 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6 empty. 2023-07-11 21:47:44,512 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,512 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 21:47:44,541 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 21:47:44,543 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => cf1412e266228e68a5a3c3d7a67debee, NAME => 'testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:47:44,544 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8ca093798e90ed4ae41e5d39f1298ba6, NAME => 'testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:47:44,591 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:44,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing cf1412e266228e68a5a3c3d7a67debee, disabling compactions & flushes 2023-07-11 21:47:44,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:44,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:44,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. after waiting 0 ms 2023-07-11 21:47:44,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:44,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:44,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for cf1412e266228e68a5a3c3d7a67debee: 2023-07-11 21:47:44,601 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:44,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8ca093798e90ed4ae41e5d39f1298ba6, disabling compactions & flushes 2023-07-11 21:47:44,602 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:44,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:44,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. after waiting 0 ms 2023-07-11 21:47:44,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:44,602 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:44,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8ca093798e90ed4ae41e5d39f1298ba6: 2023-07-11 21:47:44,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 21:47:44,609 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:47:44,610 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112064610"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112064610"}]},"ts":"1689112064610"} 2023-07-11 21:47:44,611 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112064610"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112064610"}]},"ts":"1689112064610"} 2023-07-11 21:47:44,617 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:47:44,619 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:47:44,620 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112064620"}]},"ts":"1689112064620"} 2023-07-11 21:47:44,623 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 21:47:44,627 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:47:44,629 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:47:44,629 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:47:44,629 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:47:44,629 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:47:44,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf1412e266228e68a5a3c3d7a67debee, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ca093798e90ed4ae41e5d39f1298ba6, ASSIGN}] 2023-07-11 21:47:44,633 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ca093798e90ed4ae41e5d39f1298ba6, ASSIGN 2023-07-11 21:47:44,633 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf1412e266228e68a5a3c3d7a67debee, ASSIGN 2023-07-11 21:47:44,634 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ca093798e90ed4ae41e5d39f1298ba6, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46731,1689112018018; forceNewPlan=false, retain=false 2023-07-11 21:47:44,634 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf1412e266228e68a5a3c3d7a67debee, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35055,1689112018269; forceNewPlan=false, retain=false 2023-07-11 21:47:44,784 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:47:44,792 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cf1412e266228e68a5a3c3d7a67debee, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:44,792 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8ca093798e90ed4ae41e5d39f1298ba6, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:44,793 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112064792"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112064792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112064792"}]},"ts":"1689112064792"} 2023-07-11 21:47:44,796 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112064792"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112064792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112064792"}]},"ts":"1689112064792"} 2023-07-11 21:47:44,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure cf1412e266228e68a5a3c3d7a67debee, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:47:44,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 8ca093798e90ed4ae41e5d39f1298ba6, server=jenkins-hbase17.apache.org,46731,1689112018018}] 2023-07-11 21:47:44,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 21:47:44,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:44,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf1412e266228e68a5a3c3d7a67debee, NAME => 'testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:47:44,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. service=AccessControlService 2023-07-11 21:47:44,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:44,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:44,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,959 INFO [StoreOpener-cf1412e266228e68a5a3c3d7a67debee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,963 DEBUG [StoreOpener-cf1412e266228e68a5a3c3d7a67debee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf 2023-07-11 21:47:44,963 DEBUG [StoreOpener-cf1412e266228e68a5a3c3d7a67debee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf 2023-07-11 21:47:44,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:44,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ca093798e90ed4ae41e5d39f1298ba6, NAME => 'testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:47:44,964 INFO [StoreOpener-cf1412e266228e68a5a3c3d7a67debee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf1412e266228e68a5a3c3d7a67debee columnFamilyName cf 2023-07-11 21:47:44,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. service=AccessControlService 2023-07-11 21:47:44,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:47:44,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:47:44,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,966 INFO [StoreOpener-cf1412e266228e68a5a3c3d7a67debee-1] regionserver.HStore(310): Store=cf1412e266228e68a5a3c3d7a67debee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:44,969 INFO [StoreOpener-8ca093798e90ed4ae41e5d39f1298ba6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,973 DEBUG [StoreOpener-8ca093798e90ed4ae41e5d39f1298ba6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf 2023-07-11 21:47:44,973 DEBUG [StoreOpener-8ca093798e90ed4ae41e5d39f1298ba6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf 2023-07-11 21:47:44,974 INFO [StoreOpener-8ca093798e90ed4ae41e5d39f1298ba6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ca093798e90ed4ae41e5d39f1298ba6 columnFamilyName cf 2023-07-11 21:47:44,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:47:44,975 INFO [StoreOpener-8ca093798e90ed4ae41e5d39f1298ba6-1] regionserver.HStore(310): Store=8ca093798e90ed4ae41e5d39f1298ba6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:47:44,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:47:44,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened cf1412e266228e68a5a3c3d7a67debee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59810636, jitterRate=-0.10875207185745239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:47:44,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for cf1412e266228e68a5a3c3d7a67debee: 2023-07-11 21:47:44,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee., pid=30, masterSystemTime=1689112064950 2023-07-11 21:47:44,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:47:44,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:44,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:44,986 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cf1412e266228e68a5a3c3d7a67debee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:44,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:47:44,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112064986"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112064986"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112064986"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112064986"}]},"ts":"1689112064986"} 2023-07-11 21:47:44,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8ca093798e90ed4ae41e5d39f1298ba6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72930000, jitterRate=0.08674168586730957}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:47:44,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8ca093798e90ed4ae41e5d39f1298ba6: 2023-07-11 21:47:44,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6., pid=31, masterSystemTime=1689112064953 2023-07-11 21:47:44,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:44,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:44,992 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8ca093798e90ed4ae41e5d39f1298ba6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:44,994 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112064991"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112064991"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112064991"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112064991"}]},"ts":"1689112064991"} 2023-07-11 21:47:44,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-11 21:47:44,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure cf1412e266228e68a5a3c3d7a67debee, server=jenkins-hbase17.apache.org,35055,1689112018269 in 192 msec 2023-07-11 21:47:45,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf1412e266228e68a5a3c3d7a67debee, ASSIGN in 366 msec 2023-07-11 21:47:45,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-11 21:47:45,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 8ca093798e90ed4ae41e5d39f1298ba6, server=jenkins-hbase17.apache.org,46731,1689112018018 in 199 msec 2023-07-11 21:47:45,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-11 21:47:45,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ca093798e90ed4ae41e5d39f1298ba6, ASSIGN in 379 msec 2023-07-11 21:47:45,015 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:47:45,016 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112065015"}]},"ts":"1689112065015"} 2023-07-11 21:47:45,018 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 21:47:45,026 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:47:45,027 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-11 21:47:45,034 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:47:45,035 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:45,035 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:45,035 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:45,035 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:47:45,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:47:45,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:47:45,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:47:45,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:47:45,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 541 msec 2023-07-11 21:47:45,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 21:47:45,112 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-11 21:47:45,115 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-11 21:47:45,115 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:45,118 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:47:45,143 DEBUG [hconnection-0x5a7b3011-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:45,163 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:45,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:47:45,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112065176 (current time:1689112065176). 2023-07-11 21:47:45,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:47:45,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x04fcc656 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:45,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36f16b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:45,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:45,208 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:45,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04fcc656 to 127.0.0.1:59736 2023-07-11 21:47:45,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:47:45,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x7368184a to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:45,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11c4ae07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:45,324 DEBUG [hconnection-0x6a65e810-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:45,329 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:45,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:45,340 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:45,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7368184a to 127.0.0.1:59736 2023-07-11 21:47:45,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:47:45,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:47:45,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:47:45,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:47:45,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:47:45,347 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:47:45,349 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689112665349 2023-07-11 21:47:45,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 21:47:45,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:47:45,349 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:47:45,351 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:47:45,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:47:45,355 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:47:45,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-11 21:47:45,360 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:47:45,362 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689112665362 2023-07-11 21:47:45,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,418 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-11 21:47:45,418 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:45,421 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 21:47:45,421 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 21:47:45,422 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,422 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,424 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:45,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:45,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:45,424 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:45,425 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:45,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:45,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:45,425 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:45,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:45,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 21:47:45,426 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,426 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:47:45,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:47:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,430 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:47:45,430 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:45,431 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:47:45,432 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:47:45,432 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 21:47:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 21:47:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,432 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:47:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 21:47:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,433 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:47:45,433 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,434 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,434 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:45,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,435 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:47:45,435 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:45,437 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:47:45,437 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,438 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:47:45,437 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:47:45,438 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 21:47:45,438 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:45,439 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:47:45,440 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:47:45,440 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 21:47:45,446 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:45,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:45,446 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,446 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:45,447 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,447 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:45,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 21:47:45,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc18cce[Count = 1] remaining members to acquire global barrier 2023-07-11 21:47:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:45,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:45,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,451 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:45,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:47:45,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:45,452 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:47:45,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:45,453 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 21:47:45,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc18cce[Count = 0] remaining members to acquire global barrier 2023-07-11 21:47:45,453 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,453 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 21:47:45,453 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,453 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:45,454 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,454 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,455 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,455 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:47:45,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,455 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:47:45,455 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 21:47:45,455 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:47:45,455 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:47:45,455 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,456 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,456 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:47:45,457 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:47:45,457 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:45,457 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 21:47:45,460 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:47:45,472 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:47:45,484 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:47:45,484 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:45,484 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:47:45,484 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. started... 2023-07-11 21:47:45,484 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:45,485 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. started... 2023-07-11 21:47:45,485 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf1412e266228e68a5a3c3d7a67debee: 2023-07-11 21:47:45,486 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ca093798e90ed4ae41e5d39f1298ba6: 2023-07-11 21:47:45,487 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,487 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,487 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:47:45,487 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:47:45,487 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:47:45,487 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:47:45,536 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. completed. 2023-07-11 21:47:45,537 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:45,537 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:47:45,537 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:47:45,537 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,537 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 21:47:45,537 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:47:45,538 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:47:45,538 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:45,538 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 21:47:45,545 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:45,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:45,547 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. completed. 2023-07-11 21:47:45,547 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:45,548 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:47:45,548 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:47:45,548 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,548 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 21:47:45,548 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:47:45,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:45,549 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,549 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:47:45,549 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:45,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:45,549 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 21:47:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,46731,1689112018018': 2023-07-11 21:47:45,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 21:47:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:47:45,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 21:47:45,564 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-11 21:47:45,564 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:47:45,564 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:47:45,564 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,564 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:47:45,566 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,566 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,567 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,566 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:45,567 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,566 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:45,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,567 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:45,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:45,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:45,568 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,570 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:45,571 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:45,574 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,574 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,574 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,578 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:45,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:45,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:45,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:45,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:45,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:45,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:45,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:45,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:45,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:45,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:45,581 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,581 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,581 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:45,581 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,581 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:45,581 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,582 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:45,583 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:45,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-11 21:47:45,583 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:45,583 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:45,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:47:45,583 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 21:47:45,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,653 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:45,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:47:45,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:45,655 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:47:45,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 21:47:45,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,695 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 21:47:45,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689112065349Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689112065629 (+280 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689112065629Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689112065630 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689112065639 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689112065655 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689112065695 (+40 ms) 2023-07-11 21:47:45,698 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:47:45,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 347 msec 2023-07-11 21:47:45,955 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:45,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:47:45,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:47:45,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35055] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:47:45,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46731] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:47:45,976 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-11 21:47:45,976 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:45,976 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:47:45,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:47:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112065997 (current time:1689112065997). 2023-07-11 21:47:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:47:45,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x46f9acde to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:46,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1af5749e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:46,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:46,020 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:46,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46f9acde to 127.0.0.1:59736 2023-07-11 21:47:46,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:47:46,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x6c59f3e3 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:47:46,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fee59a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:47:46,038 DEBUG [hconnection-0x16b96bd6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:46,040 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:46,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:47:46,061 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:47:46,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c59f3e3 to 127.0.0.1:59736 2023-07-11 21:47:46,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:47:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:47:46,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:47:46,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:47:46,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:47:46,070 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:47:46,072 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689112666072 2023-07-11 21:47:46,072 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 21:47:46,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:47:46,074 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:47:46,075 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:47:46,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:47:46,077 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:47:46,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-11 21:47:46,081 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:47:46,083 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689112666083 2023-07-11 21:47:46,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-11 21:47:46,119 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-11 21:47:46,119 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:46,121 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 21:47:46,121 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 21:47:46,125 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,125 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:46,126 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:46,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:46,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:46,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:46,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,128 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,128 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,128 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,128 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:47:46,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:47:46,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 21:47:46,129 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:47:46,129 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:46,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 21:47:46,132 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:47:46,132 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:46,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 21:47:46,138 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:47:46,138 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:47:46,138 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:47:46,138 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:47:46,138 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 21:47:46,138 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:47:46,138 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:47:46,138 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 21:47:46,140 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:47:46,140 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:47:46,141 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 21:47:46,146 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,147 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,147 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:46,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:46,147 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,147 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,147 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:46,147 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,147 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,148 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:46,148 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,148 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:47:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:46,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 21:47:46,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12e8b495[Count = 1] remaining members to acquire global barrier 2023-07-11 21:47:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:46,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 21:47:46,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12e8b495[Count = 0] remaining members to acquire global barrier 2023-07-11 21:47:46,152 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 21:47:46,152 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,153 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,153 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,153 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,154 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,154 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:47:46,154 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,154 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:47:46,154 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:47:46,154 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:47:46,154 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:46,154 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. started... 2023-07-11 21:47:46,154 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf1412e266228e68a5a3c3d7a67debee 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-11 21:47:46,156 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:47:46,157 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 21:47:46,157 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:47:46,157 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:47:46,157 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:47:46,157 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:47:46,157 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:46,157 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. started... 2023-07-11 21:47:46,158 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8ca093798e90ed4ae41e5d39f1298ba6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-11 21:47:46,159 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:47:46,159 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:46,159 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 21:47:46,175 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:46,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:47:46,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:46,176 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:47:46,211 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307116a76f7b87f72435ca602932dadb6f1b6 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307116a76f7b87f72435ca602932dadb6f1b6 2023-07-11 21:47:46,219 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307117e91227890e144ae861799b9faa27c76 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307117e91227890e144ae861799b9faa27c76 2023-07-11 21:47:46,268 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/.tmp/cf/19e073d22d96484a8cfa9ffd72c4b604 2023-07-11 21:47:46,278 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/.tmp/cf/ebc62ebd697f46caa21f1cffb6742e2c 2023-07-11 21:47:46,286 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/.tmp/cf/19e073d22d96484a8cfa9ffd72c4b604 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf/19e073d22d96484a8cfa9ffd72c4b604 2023-07-11 21:47:46,292 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/.tmp/cf/ebc62ebd697f46caa21f1cffb6742e2c as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf/ebc62ebd697f46caa21f1cffb6742e2c 2023-07-11 21:47:46,301 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf/ebc62ebd697f46caa21f1cffb6742e2c, entries=47, sequenceid=6, filesize=12.8 K 2023-07-11 21:47:46,303 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 8ca093798e90ed4ae41e5d39f1298ba6 in 145ms, sequenceid=6, compaction requested=false 2023-07-11 21:47:46,303 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-11 21:47:46,303 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf/19e073d22d96484a8cfa9ffd72c4b604, entries=3, sequenceid=6, filesize=5.4 K 2023-07-11 21:47:46,305 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ca093798e90ed4ae41e5d39f1298ba6: 2023-07-11 21:47:46,305 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:47:46,305 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:47:46,305 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf/ebc62ebd697f46caa21f1cffb6742e2c] hfiles 2023-07-11 21:47:46,305 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf/ebc62ebd697f46caa21f1cffb6742e2c for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:47:46,306 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cf1412e266228e68a5a3c3d7a67debee in 152ms, sequenceid=6, compaction requested=false 2023-07-11 21:47:46,308 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf1412e266228e68a5a3c3d7a67debee: 2023-07-11 21:47:46,308 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:47:46,308 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:47:46,308 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf/19e073d22d96484a8cfa9ffd72c4b604] hfiles 2023-07-11 21:47:46,308 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf/19e073d22d96484a8cfa9ffd72c4b604 for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:47:46,377 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:46,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:47:46,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:47:46,379 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:47:46,389 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. completed. 2023-07-11 21:47:46,389 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:47:46,389 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:47:46,389 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:47:46,389 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,390 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 21:47:46,390 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:47:46,394 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,394 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:47:46,394 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:46,394 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 21:47:46,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:46,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:46,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:46,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,402 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. completed. 2023-07-11 21:47:46,402 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:47:46,402 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:47:46,402 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:47:46,403 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,403 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 21:47:46,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,403 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:47:46,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,404 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:47:46,404 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:46,404 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 21:47:46,404 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:47:46,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 21:47:46,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:46,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:46,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:46,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:46,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:46,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,46731,1689112018018': 2023-07-11 21:47:46,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 21:47:46,423 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-11 21:47:46,423 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:47:46,423 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:47:46,423 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-11 21:47:46,423 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:47:46,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:46,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:47:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:47:46,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,425 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:46,425 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:47:46,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:46,426 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,426 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:47:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,430 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:47:46,430 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:47:46,430 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,434 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:46,434 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:46,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:46,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:46,434 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:46,434 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:46,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:46,434 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:47:46,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-11 21:47:46,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:46,436 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:47:46,436 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:47:46,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:47:46,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:47:46,436 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,436 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:46,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-11 21:47:46,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:47:46,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:47:46,436 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,437 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,437 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,437 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:47:46,437 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,437 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:47:46,437 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:47:46,437 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,438 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:47:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:47:46,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307117e91227890e144ae861799b9faa27c76, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307116a76f7b87f72435ca602932dadb6f1b6] mob files 2023-07-11 21:47:46,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307117e91227890e144ae861799b9faa27c76 2023-07-11 21:47:46,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307116a76f7b87f72435ca602932dadb6f1b6 2023-07-11 21:47:46,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-11 21:47:46,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 21:47:46,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,549 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689112066072Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689112066464 (+392 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689112066464Loading Region manifests for snaptb0-testExportFileSystemState at 1689112066464Writing data manifest for snaptb0-testExportFileSystemState at 1689112066485 (+21 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689112066501 (+16 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689112066549 (+48 ms) 2023-07-11 21:47:46,552 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:47:46,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 480 msec 2023-07-11 21:47:46,679 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:47:46,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:47:46,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:47:46,682 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682 2023-07-11 21:47:46,683 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:37147, tgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682, rawTgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682, srcFsUri=hdfs://localhost.localdomain:37147, srcDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:47:46,710 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:47:46,710 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1984644570_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:47:46,710 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e, snapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-11 21:47:46,739 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:47:47,194 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:47,195 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:47,196 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:47,196 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,209 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-1429073075413755010.jar 2023-07-11 21:47:48,210 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,210 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,282 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-3192986254792570907.jar 2023-07-11 21:47:48,282 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,282 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,283 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,283 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,284 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,284 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:47:48,284 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:47:48,285 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:47:48,285 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:47:48,285 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:47:48,286 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:47:48,286 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:47:48,286 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:47:48,287 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:47:48,287 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:47:48,288 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:47:48,288 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:47:48,289 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:47:48,289 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:47:48,290 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:47:48,290 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:47:48,291 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:47:48,291 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:47:48,693 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0001_000001 (auth:SIMPLE) 2023-07-11 21:47:49,666 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:47:51,351 WARN [Listener at jenkins-hbase17.apache.org/33347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:47:51,362 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-11 21:47:51,366 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-11 21:47:51,783 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:47:51,785 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:47:52,123 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0002_000001 (auth:SIMPLE) 2023-07-11 21:48:01,231 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0002_000001 (auth:SIMPLE) 2023-07-11 21:48:03,628 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0002_000001 (auth:SIMPLE) 2023-07-11 21:48:10,013 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0002_000001 (auth:SIMPLE) 2023-07-11 21:48:12,019 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:48:12,038 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:48:12,120 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-11 21:48:12,120 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:48:12,123 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:48:12,123 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 21:48:12,124 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 21:48:12,125 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 21:48:12,125 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 21:48:12,126 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 21:48:12,126 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112066682/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 21:48:12,168 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-11 21:48:12,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-07-11 21:48:12,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:48:12,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:48:12,180 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112092180"}]},"ts":"1689112092180"} 2023-07-11 21:48:12,184 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 21:48:12,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:48:12,312 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-11 21:48:12,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf1412e266228e68a5a3c3d7a67debee, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ca093798e90ed4ae41e5d39f1298ba6, UNASSIGN}] 2023-07-11 21:48:12,319 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ca093798e90ed4ae41e5d39f1298ba6, UNASSIGN 2023-07-11 21:48:12,320 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf1412e266228e68a5a3c3d7a67debee, UNASSIGN 2023-07-11 21:48:12,321 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8ca093798e90ed4ae41e5d39f1298ba6, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:12,322 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112092321"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112092321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112092321"}]},"ts":"1689112092321"} 2023-07-11 21:48:12,322 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cf1412e266228e68a5a3c3d7a67debee, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:12,322 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112092322"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112092322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112092322"}]},"ts":"1689112092322"} 2023-07-11 21:48:12,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 8ca093798e90ed4ae41e5d39f1298ba6, server=jenkins-hbase17.apache.org,46731,1689112018018}] 2023-07-11 21:48:12,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure cf1412e266228e68a5a3c3d7a67debee, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:48:12,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:48:12,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing cf1412e266228e68a5a3c3d7a67debee, disabling compactions & flushes 2023-07-11 21:48:12,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:48:12,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:48:12,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. after waiting 0 ms 2023-07-11 21:48:12,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:48:12,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:48:12,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:48:12,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8ca093798e90ed4ae41e5d39f1298ba6, disabling compactions & flushes 2023-07-11 21:48:12,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:48:12,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:48:12,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. after waiting 0 ms 2023-07-11 21:48:12,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:48:12,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:48:12,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:48:12,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee. 2023-07-11 21:48:12,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for cf1412e266228e68a5a3c3d7a67debee: 2023-07-11 21:48:12,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:48:12,614 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cf1412e266228e68a5a3c3d7a67debee, regionState=CLOSED 2023-07-11 21:48:12,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112092614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112092614"}]},"ts":"1689112092614"} 2023-07-11 21:48:12,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-11 21:48:12,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure cf1412e266228e68a5a3c3d7a67debee, server=jenkins-hbase17.apache.org,35055,1689112018269 in 287 msec 2023-07-11 21:48:12,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf1412e266228e68a5a3c3d7a67debee, UNASSIGN in 307 msec 2023-07-11 21:48:12,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:48:12,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:48:12,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6. 2023-07-11 21:48:12,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8ca093798e90ed4ae41e5d39f1298ba6: 2023-07-11 21:48:12,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:48:12,646 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8ca093798e90ed4ae41e5d39f1298ba6, regionState=CLOSED 2023-07-11 21:48:12,646 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112092646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112092646"}]},"ts":"1689112092646"} 2023-07-11 21:48:12,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-11 21:48:12,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 8ca093798e90ed4ae41e5d39f1298ba6, server=jenkins-hbase17.apache.org,46731,1689112018018 in 321 msec 2023-07-11 21:48:12,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-11 21:48:12,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ca093798e90ed4ae41e5d39f1298ba6, UNASSIGN in 344 msec 2023-07-11 21:48:12,668 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112092668"}]},"ts":"1689112092668"} 2023-07-11 21:48:12,671 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 21:48:12,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:48:12,802 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-11 21:48:12,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 634 msec 2023-07-11 21:48:13,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:48:13,292 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-11 21:48:13,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-07-11 21:48:13,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:48:13,305 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:48:13,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-11 21:48:13,306 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:48:13,309 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-11 21:48:13,311 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:48:13,311 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:48:13,311 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:48:13,311 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:48:13,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 21:48:13,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 21:48:13,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 21:48:13,313 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:48:13,313 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:48:13,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-11 21:48:13,313 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 21:48:13,313 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:48:13,313 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:48:13,313 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:48:13,313 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:48:13,314 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:48:13,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 21:48:13,320 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:48:13,336 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:48:13,340 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/recovered.edits] 2023-07-11 21:48:13,354 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/recovered.edits] 2023-07-11 21:48:13,360 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf/ebc62ebd697f46caa21f1cffb6742e2c to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/cf/ebc62ebd697f46caa21f1cffb6742e2c 2023-07-11 21:48:13,363 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf/19e073d22d96484a8cfa9ffd72c4b604 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/cf/19e073d22d96484a8cfa9ffd72c4b604 2023-07-11 21:48:13,367 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6/recovered.edits/9.seqid 2023-07-11 21:48:13,371 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/8ca093798e90ed4ae41e5d39f1298ba6 2023-07-11 21:48:13,376 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee/recovered.edits/9.seqid 2023-07-11 21:48:13,380 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemState/cf1412e266228e68a5a3c3d7a67debee 2023-07-11 21:48:13,380 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 21:48:13,382 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-11 21:48:13,386 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-11 21:48:13,393 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307117e91227890e144ae861799b9faa27c76 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307117e91227890e144ae861799b9faa27c76 2023-07-11 21:48:13,395 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307116a76f7b87f72435ca602932dadb6f1b6 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307116a76f7b87f72435ca602932dadb6f1b6 2023-07-11 21:48:13,396 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-11 21:48:13,403 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:48:13,409 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-11 21:48:13,415 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-11 21:48:13,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 21:48:13,424 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:48:13,425 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-11 21:48:13,425 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112093425"}]},"ts":"9223372036854775807"} 2023-07-11 21:48:13,425 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112093425"}]},"ts":"9223372036854775807"} 2023-07-11 21:48:13,455 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 21:48:13,456 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cf1412e266228e68a5a3c3d7a67debee, NAME => 'testtb-testExportFileSystemState,,1689112064494.cf1412e266228e68a5a3c3d7a67debee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8ca093798e90ed4ae41e5d39f1298ba6, NAME => 'testtb-testExportFileSystemState,1,1689112064494.8ca093798e90ed4ae41e5d39f1298ba6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 21:48:13,456 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-11 21:48:13,456 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112093456"}]},"ts":"9223372036854775807"} 2023-07-11 21:48:13,459 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-11 21:48:13,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:48:13,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 173 msec 2023-07-11 21:48:13,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 21:48:13,621 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-11 21:48:13,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-11 21:48:13,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-11 21:48:13,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-07-11 21:48:13,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-11 21:48:13,725 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=742 (was 749), OpenFileDescriptor=909 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1120 (was 988) - SystemLoadAverage LEAK? -, ProcessCount=188 (was 189), AvailableMemoryMB=2025 (was 2642) 2023-07-11 21:48:13,726 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=742 is superior to 500 2023-07-11 21:48:13,756 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=742, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=1120, ProcessCount=189, AvailableMemoryMB=2023 2023-07-11 21:48:13,756 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=742 is superior to 500 2023-07-11 21:48:13,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 21:48:13,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:48:13,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:48:13,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-11 21:48:13,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:48:13,771 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:48:13,801 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:13,804 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:13,804 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122 empty. 2023-07-11 21:48:13,809 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:13,809 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040 empty. 2023-07-11 21:48:13,809 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:13,810 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 21:48:13,857 WARN [DataStreamer for file /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/.tmp/.tableinfo.0000000001] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 21:48:13,860 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-11 21:48:13,861 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a7388b3b5916725921988f0c79da9122, NAME => 'testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:48:13,861 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => cddb22b24a9d4bfd80352250f2d05040, NAME => 'testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:48:13,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:48:13,943 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:48:13,946 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a7388b3b5916725921988f0c79da9122, disabling compactions & flushes 2023-07-11 21:48:13,946 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:13,946 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:13,946 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. after waiting 0 ms 2023-07-11 21:48:13,947 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:13,947 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:13,947 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a7388b3b5916725921988f0c79da9122: 2023-07-11 21:48:13,951 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:48:13,951 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing cddb22b24a9d4bfd80352250f2d05040, disabling compactions & flushes 2023-07-11 21:48:13,951 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:13,951 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:13,951 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. after waiting 0 ms 2023-07-11 21:48:13,951 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:13,951 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:13,951 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for cddb22b24a9d4bfd80352250f2d05040: 2023-07-11 21:48:13,959 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:48:13,961 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112093961"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112093961"}]},"ts":"1689112093961"} 2023-07-11 21:48:13,961 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112093961"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112093961"}]},"ts":"1689112093961"} 2023-07-11 21:48:13,968 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:48:13,973 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:48:13,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112093973"}]},"ts":"1689112093973"} 2023-07-11 21:48:13,976 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-11 21:48:13,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:48:13,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:48:13,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:48:13,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:48:13,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:48:13,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7388b3b5916725921988f0c79da9122, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cddb22b24a9d4bfd80352250f2d05040, ASSIGN}] 2023-07-11 21:48:13,986 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7388b3b5916725921988f0c79da9122, ASSIGN 2023-07-11 21:48:13,986 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cddb22b24a9d4bfd80352250f2d05040, ASSIGN 2023-07-11 21:48:13,988 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7388b3b5916725921988f0c79da9122, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34193,1689112018101; forceNewPlan=false, retain=false 2023-07-11 21:48:13,988 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cddb22b24a9d4bfd80352250f2d05040, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35055,1689112018269; forceNewPlan=false, retain=false 2023-07-11 21:48:14,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:48:14,138 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:48:14,143 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a7388b3b5916725921988f0c79da9122, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:14,143 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=cddb22b24a9d4bfd80352250f2d05040, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:14,143 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112094143"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112094143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112094143"}]},"ts":"1689112094143"} 2023-07-11 21:48:14,143 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112094143"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112094143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112094143"}]},"ts":"1689112094143"} 2023-07-11 21:48:14,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure a7388b3b5916725921988f0c79da9122, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:48:14,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure cddb22b24a9d4bfd80352250f2d05040, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:48:14,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:14,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cddb22b24a9d4bfd80352250f2d05040, NAME => 'testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:48:14,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. service=AccessControlService 2023-07-11 21:48:14,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:48:14,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:14,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:48:14,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:14,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:14,359 INFO [StoreOpener-cddb22b24a9d4bfd80352250f2d05040-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:14,364 DEBUG [StoreOpener-cddb22b24a9d4bfd80352250f2d05040-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf 2023-07-11 21:48:14,364 DEBUG [StoreOpener-cddb22b24a9d4bfd80352250f2d05040-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf 2023-07-11 21:48:14,365 INFO [StoreOpener-cddb22b24a9d4bfd80352250f2d05040-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cddb22b24a9d4bfd80352250f2d05040 columnFamilyName cf 2023-07-11 21:48:14,367 INFO [StoreOpener-cddb22b24a9d4bfd80352250f2d05040-1] regionserver.HStore(310): Store=cddb22b24a9d4bfd80352250f2d05040/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:48:14,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:14,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7388b3b5916725921988f0c79da9122, NAME => 'testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:48:14,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. service=AccessControlService 2023-07-11 21:48:14,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:48:14,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:14,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:48:14,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:14,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:14,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:14,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:14,383 INFO [StoreOpener-a7388b3b5916725921988f0c79da9122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:14,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:48:14,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:48:14,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:48:14,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened cddb22b24a9d4bfd80352250f2d05040; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59469044, jitterRate=-0.1138421893119812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:48:14,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for cddb22b24a9d4bfd80352250f2d05040: 2023-07-11 21:48:14,401 DEBUG [StoreOpener-a7388b3b5916725921988f0c79da9122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf 2023-07-11 21:48:14,401 DEBUG [StoreOpener-a7388b3b5916725921988f0c79da9122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf 2023-07-11 21:48:14,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040., pid=46, masterSystemTime=1689112094318 2023-07-11 21:48:14,401 INFO [StoreOpener-a7388b3b5916725921988f0c79da9122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7388b3b5916725921988f0c79da9122 columnFamilyName cf 2023-07-11 21:48:14,403 INFO [StoreOpener-a7388b3b5916725921988f0c79da9122-1] regionserver.HStore(310): Store=a7388b3b5916725921988f0c79da9122/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:48:14,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:14,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:14,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:14,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:14,411 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=cddb22b24a9d4bfd80352250f2d05040, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:14,411 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112094411"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112094411"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112094411"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112094411"}]},"ts":"1689112094411"} 2023-07-11 21:48:14,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a7388b3b5916725921988f0c79da9122 2023-07-11 21:48:14,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-11 21:48:14,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure cddb22b24a9d4bfd80352250f2d05040, server=jenkins-hbase17.apache.org,35055,1689112018269 in 257 msec 2023-07-11 21:48:14,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cddb22b24a9d4bfd80352250f2d05040, ASSIGN in 450 msec 2023-07-11 21:48:14,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:48:14,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a7388b3b5916725921988f0c79da9122; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67980266, jitterRate=0.012984901666641235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:48:14,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a7388b3b5916725921988f0c79da9122: 2023-07-11 21:48:14,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122., pid=45, masterSystemTime=1689112094313 2023-07-11 21:48:14,458 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a7388b3b5916725921988f0c79da9122, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:14,458 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112094458"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112094458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112094458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112094458"}]},"ts":"1689112094458"} 2023-07-11 21:48:14,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-11 21:48:14,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure a7388b3b5916725921988f0c79da9122, server=jenkins-hbase17.apache.org,34193,1689112018101 in 303 msec 2023-07-11 21:48:14,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:14,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:14,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-11 21:48:14,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7388b3b5916725921988f0c79da9122, ASSIGN in 481 msec 2023-07-11 21:48:14,477 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:48:14,477 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112094477"}]},"ts":"1689112094477"} 2023-07-11 21:48:14,480 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-11 21:48:14,487 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:48:14,487 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-11 21:48:14,490 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 21:48:14,492 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:48:14,492 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:48:14,492 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:48:14,492 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:48:14,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 21:48:14,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 21:48:14,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 21:48:14,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 21:48:14,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 735 msec 2023-07-11 21:48:14,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:48:14,887 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-11 21:48:14,892 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-11 21:48:14,893 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:14,907 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:48:14,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:48:14,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112094936 (current time:1689112094936). 2023-07-11 21:48:14,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:48:14,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x5086157e to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:48:14,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73bc3fed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:48:14,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:48:14,980 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:48:14,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5086157e to 127.0.0.1:59736 2023-07-11 21:48:14,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:48:14,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x5aaae9b4 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:48:15,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a672a7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:48:15,041 DEBUG [hconnection-0x2836298c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:48:15,047 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:48:15,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:48:15,065 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:48:15,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aaae9b4 to 127.0.0.1:59736 2023-07-11 21:48:15,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:48:15,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 21:48:15,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:48:15,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:48:15,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:48:15,088 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:48:15,089 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689112695089 2023-07-11 21:48:15,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:48:15,095 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 21:48:15,100 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:48:15,100 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:48:15,104 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:48:15,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:48:15,106 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 29 msec 2023-07-11 21:48:15,109 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:48:15,112 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689112695112 2023-07-11 21:48:15,201 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:15,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:15,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:48:15,202 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:48:15,403 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:15,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:15,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:48:15,406 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:48:15,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,568 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-11 21:48:15,568 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:48:15,568 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 21:48:15,568 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 21:48:15,569 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,569 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,570 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:15,570 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:15,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:15,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:15,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:15,570 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:15,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:15,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:15,570 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:15,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 21:48:15,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:48:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,573 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,573 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 21:48:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,575 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,575 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:48:15,575 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:48:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 21:48:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,575 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:48:15,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,584 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:48:15,584 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:48:15,586 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:48:15,586 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:48:15,586 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 21:48:15,588 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,589 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,589 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:48:15,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,589 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:48:15,589 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:48:15,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,599 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:48:15,599 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:48:15,599 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:48:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:48:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:48:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 21:48:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:48:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 21:48:15,608 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,608 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:15,614 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:15,614 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,614 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,614 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:48:15,614 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:48:15,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:15,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:15,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 21:48:15,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fd71116[Count = 1] remaining members to acquire global barrier 2023-07-11 21:48:15,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:15,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:15,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:15,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:15,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 21:48:15,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fd71116[Count = 0] remaining members to acquire global barrier 2023-07-11 21:48:15,626 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 21:48:15,626 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,627 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:48:15,628 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,628 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,628 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:48:15,628 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:48:15,628 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 21:48:15,628 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:48:15,629 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,629 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:48:15,630 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:48:15,630 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:48:15,630 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 21:48:15,636 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:48:15,636 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:48:15,641 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:15,642 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. started... 2023-07-11 21:48:15,642 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7388b3b5916725921988f0c79da9122: 2023-07-11 21:48:15,642 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,642 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:48:15,642 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:48:15,644 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:48:15,644 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:48:15,644 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:15,644 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. started... 2023-07-11 21:48:15,648 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cddb22b24a9d4bfd80352250f2d05040: 2023-07-11 21:48:15,651 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,662 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:48:15,662 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:48:15,706 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:15,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:15,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:48:15,709 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:48:15,741 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. completed. 2023-07-11 21:48:15,741 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:15,743 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:48:15,743 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:48:15,743 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,743 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 21:48:15,744 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:48:15,753 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:48:15,753 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,753 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:48:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:15,754 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 21:48:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:48:15,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 21:48:15,802 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. completed. 2023-07-11 21:48:15,803 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:15,812 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:48:15,812 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:48:15,812 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,812 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 21:48:15,812 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:48:15,817 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,817 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:48:15,818 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:48:15,818 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 21:48:15,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:15,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:15,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:48:15,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 21:48:15,833 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-11 21:48:15,833 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:48:15,833 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:48:15,833 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,833 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:48:15,835 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,835 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:15,835 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,835 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,835 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:15,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,835 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,836 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:15,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:15,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:15,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:15,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:15,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:15,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:15,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:15,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:15,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,839 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:15,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,839 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,840 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,850 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,851 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,852 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,869 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:15,869 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:15,869 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,869 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,869 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:15,869 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:15,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:15,869 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:15,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:15,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:15,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-11 21:48:15,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,870 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:15,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:48:15,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:15,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:15,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 21:48:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:15,869 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,872 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,872 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:15,872 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,872 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:15,872 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:15,872 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,872 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,870 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:15,870 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:48:15,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:15,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:15,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:15,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:15,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:15,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:16,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:16,209 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:16,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:16,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:48:16,211 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 21:48:16,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 21:48:16,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:16,281 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 21:48:16,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689112095095Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689112095953 (+858 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689112095953Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689112095953Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689112095969 (+16 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689112096047 (+78 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689112096279 (+232 ms) 2023-07-11 21:48:16,289 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:48:16,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.1900 sec 2023-07-11 21:48:16,349 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0002_000001 (auth:SIMPLE) 2023-07-11 21:48:17,211 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:17,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:17,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:48:17,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34193] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:48:17,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35055] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:48:17,229 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-11 21:48:17,229 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:17,229 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:48:17,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:48:17,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112097247 (current time:1689112097247). 2023-07-11 21:48:17,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:48:17,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x59715a98 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:48:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@409a2b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:48:17,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:48:17,305 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:48:17,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59715a98 to 127.0.0.1:59736 2023-07-11 21:48:17,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:48:17,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x1e925674 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:48:17,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@306695c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:48:17,385 DEBUG [hconnection-0x3f754231-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:48:17,392 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:48:17,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:48:17,415 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:48:17,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e925674 to 127.0.0.1:59736 2023-07-11 21:48:17,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:48:17,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 21:48:17,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:48:17,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:48:17,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:48:17,432 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:48:17,434 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689112697434 2023-07-11 21:48:17,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:48:17,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 21:48:17,435 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:48:17,435 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:48:17,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:48:17,446 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:48:17,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 18 msec 2023-07-11 21:48:17,462 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:48:17,463 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689112697463 2023-07-11 21:48:17,535 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:17,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:17,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:48:17,537 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:48:17,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-11 21:48:17,592 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-11 21:48:17,592 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:48:17,592 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 21:48:17,592 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 21:48:17,593 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,593 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,595 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:17,595 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:17,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:17,595 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:17,595 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:17,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:17,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,596 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:17,596 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:17,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,596 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:17,596 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:48:17,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,597 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:48:17,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 21:48:17,600 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:48:17,600 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:48:17,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 21:48:17,601 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:48:17,601 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:48:17,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 21:48:17,617 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:48:17,617 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:48:17,617 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:48:17,617 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:48:17,617 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 21:48:17,617 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:48:17,617 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:48:17,618 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 21:48:17,619 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:48:17,619 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:48:17,619 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 21:48:17,621 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,621 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:17,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:17,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:17,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:17,622 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:17,623 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,623 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:17,623 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,623 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,623 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:48:17,623 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:48:17,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:17,624 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,624 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:48:17,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:17,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 21:48:17,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69fb9989[Count = 1] remaining members to acquire global barrier 2023-07-11 21:48:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:17,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:17,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 21:48:17,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69fb9989[Count = 0] remaining members to acquire global barrier 2023-07-11 21:48:17,638 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 21:48:17,638 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,639 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,639 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,639 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:48:17,639 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 21:48:17,639 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:48:17,639 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,639 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:48:17,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:17,640 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:48:17,640 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:17,641 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:17,641 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:48:17,642 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:48:17,642 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:48:17,642 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 21:48:17,651 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:48:17,653 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:48:17,659 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:48:17,659 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:48:17,660 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:17,660 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. started... 2023-07-11 21:48:17,660 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a7388b3b5916725921988f0c79da9122 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-11 21:48:17,666 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:17,667 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. started... 2023-07-11 21:48:17,671 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cddb22b24a9d4bfd80352250f2d05040 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-11 21:48:17,737 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:17,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:17,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:48:17,739 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:48:17,879 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711be1196c7bac542b19e7cd4f437e4e00f to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711be1196c7bac542b19e7cd4f437e4e00f 2023-07-11 21:48:17,950 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/.tmp/cf/895e54ce35304ab7a72b146fd2c794e4 2023-07-11 21:48:17,951 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711eee93c16d1644e01b5d5558090ac0757 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711eee93c16d1644e01b5d5558090ac0757 2023-07-11 21:48:17,966 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/.tmp/cf/895e54ce35304ab7a72b146fd2c794e4 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf/895e54ce35304ab7a72b146fd2c794e4 2023-07-11 21:48:17,987 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf/895e54ce35304ab7a72b146fd2c794e4, entries=49, sequenceid=6, filesize=13.0 K 2023-07-11 21:48:17,992 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/.tmp/cf/8600e73ad8424b35b1a34f94ac6a9f2b 2023-07-11 21:48:18,000 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for cddb22b24a9d4bfd80352250f2d05040 in 329ms, sequenceid=6, compaction requested=false 2023-07-11 21:48:18,000 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-11 21:48:18,001 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cddb22b24a9d4bfd80352250f2d05040: 2023-07-11 21:48:18,001 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 21:48:18,001 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:48:18,001 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf/895e54ce35304ab7a72b146fd2c794e4] hfiles 2023-07-11 21:48:18,001 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf/895e54ce35304ab7a72b146fd2c794e4 for snapshot=snaptb0-testConsecutiveExports 2023-07-11 21:48:18,008 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/.tmp/cf/8600e73ad8424b35b1a34f94ac6a9f2b as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf/8600e73ad8424b35b1a34f94ac6a9f2b 2023-07-11 21:48:18,024 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf/8600e73ad8424b35b1a34f94ac6a9f2b, entries=1, sequenceid=6, filesize=5.1 K 2023-07-11 21:48:18,025 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for a7388b3b5916725921988f0c79da9122 in 365ms, sequenceid=6, compaction requested=false 2023-07-11 21:48:18,027 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7388b3b5916725921988f0c79da9122: 2023-07-11 21:48:18,027 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 21:48:18,028 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:48:18,028 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf/8600e73ad8424b35b1a34f94ac6a9f2b] hfiles 2023-07-11 21:48:18,028 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf/8600e73ad8424b35b1a34f94ac6a9f2b for snapshot=snaptb0-testConsecutiveExports 2023-07-11 21:48:18,039 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:18,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:18,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:48:18,045 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:48:18,065 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. completed. 2023-07-11 21:48:18,065 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:48:18,065 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:48:18,065 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:48:18,065 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,065 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 21:48:18,065 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:48:18,069 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,069 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:48:18,069 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:48:18,069 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 21:48:18,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:18,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:18,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:18,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:18,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:18,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:48:18,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 21:48:18,114 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. completed. 2023-07-11 21:48:18,114 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:48:18,114 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:48:18,114 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:48:18,114 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,114 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 21:48:18,114 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:48:18,121 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:48:18,122 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:48:18,122 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 21:48:18,121 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:48:18,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 21:48:18,133 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-11 21:48:18,133 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:48:18,133 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:48:18,133 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-11 21:48:18,133 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:48:18,139 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:18,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:18,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:48:18,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:48:18,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,139 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:18,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:18,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:18,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:18,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:18,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:18,142 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,143 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:48:18,143 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:18,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:48:18,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:18,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,146 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,147 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:48:18,148 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 21:48:18,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,154 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:18,154 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:18,154 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:48:18,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:18,154 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:18,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:18,154 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:18,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:48:18,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:48:18,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:48:18,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:18,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:18,157 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:48:18,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:48:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:48:18,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-11 21:48:18,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-11 21:48:18,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 21:48:18,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:48:18,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711be1196c7bac542b19e7cd4f437e4e00f, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711eee93c16d1644e01b5d5558090ac0757] mob files 2023-07-11 21:48:18,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711be1196c7bac542b19e7cd4f437e4e00f 2023-07-11 21:48:18,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711eee93c16d1644e01b5d5558090ac0757 2023-07-11 21:48:18,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-11 21:48:18,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,402 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:48:18,545 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:18,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:18,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:48:18,547 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 21:48:18,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 21:48:18,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,972 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 21:48:18,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689112097434Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689112098257 (+823 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689112098257Loading Region manifests for snaptb0-testConsecutiveExports at 1689112098257Writing data manifest for snaptb0-testConsecutiveExports at 1689112098342 (+85 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689112098632 (+290 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689112098971 (+339 ms) 2023-07-11 21:48:18,976 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:48:18,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.5380 sec 2023-07-11 21:48:19,547 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:48:19,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:48:19,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:48:19,551 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551 2023-07-11 21:48:19,551 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551, srcFsUri=hdfs://localhost.localdomain:37147, srcDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:48:19,604 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:48:19,604 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@67ca8c2f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 21:48:19,604 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e, snapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 21:48:19,654 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 21:48:19,732 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:19,733 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:19,734 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:19,734 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,849 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-4060990268800588555.jar 2023-07-11 21:48:21,850 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,851 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,945 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-1173087757918447814.jar 2023-07-11 21:48:21,945 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,946 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,946 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,949 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,949 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,950 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:21,951 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:48:21,951 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:48:21,952 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:48:21,952 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:48:21,953 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:48:21,954 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:48:21,954 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:48:21,955 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:48:21,955 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:48:21,956 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:48:21,957 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:48:21,957 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:48:21,958 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:48:21,960 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:48:21,961 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:48:21,962 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:48:21,963 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:48:26,047 WARN [Listener at jenkins-hbase17.apache.org/33347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:48:26,059 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 21:48:26,071 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-11 21:48:26,440 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:48:26,442 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:48:27,162 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0003_000001 (auth:SIMPLE) 2023-07-11 21:48:38,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0003_000001 (auth:SIMPLE) 2023-07-11 21:48:41,138 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0003_000001 (auth:SIMPLE) 2023-07-11 21:48:44,507 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0003_000001 (auth:SIMPLE) 2023-07-11 21:48:44,530 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689112033037_0003_01_000002 is : 143 2023-07-11 21:48:45,727 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:48:45,727 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:48:45,759 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 21:48:45,759 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:48:45,760 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:48:45,760 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 21:48:45,765 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 21:48:45,765 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 21:48:45,765 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@46f50f91 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 21:48:45,765 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 21:48:45,765 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 21:48:45,767 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551, srcFsUri=hdfs://localhost.localdomain:37147, srcDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:48:45,798 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:48:45,799 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6998fcf6, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 21:48:45,799 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e, snapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 21:48:45,843 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 21:48:45,899 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:45,900 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:45,900 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:45,901 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,126 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-517536981315786279.jar 2023-07-11 21:48:47,126 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,127 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,225 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-4144813701679797327.jar 2023-07-11 21:48:47,225 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,226 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,227 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,227 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,228 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,228 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:48:47,229 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:48:47,230 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:48:47,230 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:48:47,231 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:48:47,231 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:48:47,232 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:48:47,233 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:48:47,233 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:48:47,234 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:48:47,235 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:48:47,235 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:48:47,236 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:48:47,237 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:48:47,237 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:48:47,237 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:48:47,238 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:48:47,239 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:48:49,307 WARN [Listener at jenkins-hbase17.apache.org/33347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:48:49,310 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 21:48:49,332 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-11 21:48:50,755 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:48:50,769 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:48:50,773 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0003_000001 (auth:SIMPLE) 2023-07-11 21:48:51,396 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0004_000001 (auth:SIMPLE) 2023-07-11 21:49:03,875 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0004_000001 (auth:SIMPLE) 2023-07-11 21:49:06,398 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0004_000001 (auth:SIMPLE) 2023-07-11 21:49:14,895 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:49:14,895 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:49:14,898 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 21:49:14,898 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:49:14,899 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:49:14,899 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 21:49:14,905 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 21:49:14,905 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 21:49:14,905 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@46f50f91 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 21:49:14,905 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 21:49:14,906 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/local-export-1689112099551/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 21:49:14,918 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-11 21:49:14,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-07-11 21:49:14,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:49:14,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 21:49:14,924 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112154924"}]},"ts":"1689112154924"} 2023-07-11 21:49:14,926 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-11 21:49:15,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 21:49:15,045 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-11 21:49:15,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7388b3b5916725921988f0c79da9122, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cddb22b24a9d4bfd80352250f2d05040, UNASSIGN}] 2023-07-11 21:49:15,049 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7388b3b5916725921988f0c79da9122, UNASSIGN 2023-07-11 21:49:15,049 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cddb22b24a9d4bfd80352250f2d05040, UNASSIGN 2023-07-11 21:49:15,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=cddb22b24a9d4bfd80352250f2d05040, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:15,051 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a7388b3b5916725921988f0c79da9122, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:15,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112155051"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112155051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112155051"}]},"ts":"1689112155051"} 2023-07-11 21:49:15,052 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112155051"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112155051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112155051"}]},"ts":"1689112155051"} 2023-07-11 21:49:15,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure cddb22b24a9d4bfd80352250f2d05040, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:49:15,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure a7388b3b5916725921988f0c79da9122, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:49:15,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:49:15,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing cddb22b24a9d4bfd80352250f2d05040, disabling compactions & flushes 2023-07-11 21:49:15,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:49:15,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:49:15,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. after waiting 0 ms 2023-07-11 21:49:15,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:49:15,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a7388b3b5916725921988f0c79da9122 2023-07-11 21:49:15,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a7388b3b5916725921988f0c79da9122, disabling compactions & flushes 2023-07-11 21:49:15,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:49:15,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:49:15,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. after waiting 0 ms 2023-07-11 21:49:15,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:49:15,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:49:15,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:49:15,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040. 2023-07-11 21:49:15,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:49:15,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for cddb22b24a9d4bfd80352250f2d05040: 2023-07-11 21:49:15,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:49:15,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122. 2023-07-11 21:49:15,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a7388b3b5916725921988f0c79da9122: 2023-07-11 21:49:15,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:49:15,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=cddb22b24a9d4bfd80352250f2d05040, regionState=CLOSED 2023-07-11 21:49:15,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a7388b3b5916725921988f0c79da9122 2023-07-11 21:49:15,225 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112155224"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112155224"}]},"ts":"1689112155224"} 2023-07-11 21:49:15,225 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a7388b3b5916725921988f0c79da9122, regionState=CLOSED 2023-07-11 21:49:15,225 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112155225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112155225"}]},"ts":"1689112155225"} 2023-07-11 21:49:15,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 21:49:15,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-11 21:49:15,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure cddb22b24a9d4bfd80352250f2d05040, server=jenkins-hbase17.apache.org,35055,1689112018269 in 175 msec 2023-07-11 21:49:15,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-11 21:49:15,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure a7388b3b5916725921988f0c79da9122, server=jenkins-hbase17.apache.org,34193,1689112018101 in 174 msec 2023-07-11 21:49:15,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cddb22b24a9d4bfd80352250f2d05040, UNASSIGN in 183 msec 2023-07-11 21:49:15,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-11 21:49:15,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7388b3b5916725921988f0c79da9122, UNASSIGN in 184 msec 2023-07-11 21:49:15,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112155232"}]},"ts":"1689112155232"} 2023-07-11 21:49:15,233 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-11 21:49:15,303 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-11 21:49:15,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 385 msec 2023-07-11 21:49:15,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 21:49:15,527 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-11 21:49:15,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-07-11 21:49:15,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:49:15,531 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:49:15,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-11 21:49:15,532 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:49:15,535 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-11 21:49:15,538 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122 2023-07-11 21:49:15,538 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:49:15,542 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/recovered.edits] 2023-07-11 21:49:15,542 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/recovered.edits] 2023-07-11 21:49:15,547 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf/8600e73ad8424b35b1a34f94ac6a9f2b to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/cf/8600e73ad8424b35b1a34f94ac6a9f2b 2023-07-11 21:49:15,548 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf/895e54ce35304ab7a72b146fd2c794e4 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/cf/895e54ce35304ab7a72b146fd2c794e4 2023-07-11 21:49:15,552 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122/recovered.edits/9.seqid 2023-07-11 21:49:15,554 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040/recovered.edits/9.seqid 2023-07-11 21:49:15,556 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/a7388b3b5916725921988f0c79da9122 2023-07-11 21:49:15,556 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testConsecutiveExports/cddb22b24a9d4bfd80352250f2d05040 2023-07-11 21:49:15,556 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 21:49:15,557 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-11 21:49:15,559 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-11 21:49:15,566 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711be1196c7bac542b19e7cd4f437e4e00f to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711be1196c7bac542b19e7cd4f437e4e00f 2023-07-11 21:49:15,568 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711eee93c16d1644e01b5d5558090ac0757 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711eee93c16d1644e01b5d5558090ac0757 2023-07-11 21:49:15,569 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-11 21:49:15,577 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:49:15,579 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-11 21:49:15,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-11 21:49:15,583 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:49:15,584 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-11 21:49:15,584 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112155584"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:15,584 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112155584"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:15,587 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 21:49:15,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a7388b3b5916725921988f0c79da9122, NAME => 'testtb-testConsecutiveExports,,1689112093758.a7388b3b5916725921988f0c79da9122.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cddb22b24a9d4bfd80352250f2d05040, NAME => 'testtb-testConsecutiveExports,1,1689112093758.cddb22b24a9d4bfd80352250f2d05040.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 21:49:15,587 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-11 21:49:15,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112155587"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:15,589 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-11 21:49:15,600 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 21:49:15,602 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 21:49:15,602 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 21:49:15,602 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 21:49:15,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 21:49:15,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 21:49:15,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 21:49:15,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 21:49:15,642 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:49:15,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 114 msec 2023-07-11 21:49:15,737 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 21:49:15,737 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:15,737 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 21:49:15,737 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:15,737 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 21:49:15,737 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:15,738 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 21:49:15,738 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:15,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 21:49:15,739 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-11 21:49:15,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-11 21:49:15,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-11 21:49:15,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-07-11 21:49:15,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-11 21:49:15,803 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743 (was 742) Potentially hanging thread: ApplicationMasterLauncher #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1893239302_1 at /127.0.0.1:35238 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3320 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to jenkins-hbase17.apache.org/136.243.18.41:44791 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:60738 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:34636 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=886 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1630 (was 1120) - SystemLoadAverage LEAK? -, ProcessCount=195 (was 189) - ProcessCount LEAK? -, AvailableMemoryMB=927 (was 2023) 2023-07-11 21:49:15,804 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-11 21:49:15,847 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=743, OpenFileDescriptor=886, MaxFileDescriptor=60000, SystemLoadAverage=1630, ProcessCount=195, AvailableMemoryMB=927 2023-07-11 21:49:15,847 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-11 21:49:15,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 21:49:15,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:15,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:49:15,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-11 21:49:15,858 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:49:15,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 21:49:15,860 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:15,861 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41 empty. 2023-07-11 21:49:15,861 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:15,865 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:15,867 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9 empty. 2023-07-11 21:49:15,868 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:15,868 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 21:49:15,903 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-11 21:49:15,904 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => f4841c4786724783939b425cc0fcdf41, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:49:15,904 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 28c8bcf12eaa484e59bd3772d519c1a9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:49:15,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:15,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 28c8bcf12eaa484e59bd3772d519c1a9, disabling compactions & flushes 2023-07-11 21:49:15,958 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:15,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:15,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. after waiting 0 ms 2023-07-11 21:49:15,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:15,958 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:15,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 28c8bcf12eaa484e59bd3772d519c1a9: 2023-07-11 21:49:15,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 21:49:16,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 21:49:16,362 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:16,362 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing f4841c4786724783939b425cc0fcdf41, disabling compactions & flushes 2023-07-11 21:49:16,363 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:16,363 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:16,363 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. after waiting 0 ms 2023-07-11 21:49:16,363 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:16,363 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:16,363 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for f4841c4786724783939b425cc0fcdf41: 2023-07-11 21:49:16,365 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:49:16,367 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112156366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112156366"}]},"ts":"1689112156366"} 2023-07-11 21:49:16,367 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112156366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112156366"}]},"ts":"1689112156366"} 2023-07-11 21:49:16,374 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:49:16,376 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:49:16,376 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112156376"}]},"ts":"1689112156376"} 2023-07-11 21:49:16,378 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-11 21:49:16,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 21:49:16,866 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:49:16,869 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:49:16,870 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:49:16,870 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:49:16,870 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:49:16,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=28c8bcf12eaa484e59bd3772d519c1a9, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4841c4786724783939b425cc0fcdf41, ASSIGN}] 2023-07-11 21:49:16,874 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=28c8bcf12eaa484e59bd3772d519c1a9, ASSIGN 2023-07-11 21:49:16,875 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4841c4786724783939b425cc0fcdf41, ASSIGN 2023-07-11 21:49:16,879 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=28c8bcf12eaa484e59bd3772d519c1a9, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46731,1689112018018; forceNewPlan=false, retain=false 2023-07-11 21:49:16,879 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4841c4786724783939b425cc0fcdf41, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34193,1689112018101; forceNewPlan=false, retain=false 2023-07-11 21:49:16,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 21:49:17,030 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:49:17,033 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=28c8bcf12eaa484e59bd3772d519c1a9, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:17,033 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f4841c4786724783939b425cc0fcdf41, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:17,033 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112157033"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112157033"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112157033"}]},"ts":"1689112157033"} 2023-07-11 21:49:17,034 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112157033"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112157033"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112157033"}]},"ts":"1689112157033"} 2023-07-11 21:49:17,036 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 28c8bcf12eaa484e59bd3772d519c1a9, server=jenkins-hbase17.apache.org,46731,1689112018018}] 2023-07-11 21:49:17,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure f4841c4786724783939b425cc0fcdf41, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:49:17,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:17,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4841c4786724783939b425cc0fcdf41, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:49:17,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. service=AccessControlService 2023-07-11 21:49:17,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:49:17,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:17,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:17,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:17,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:17,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:17,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28c8bcf12eaa484e59bd3772d519c1a9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:49:17,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. service=AccessControlService 2023-07-11 21:49:17,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:49:17,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:17,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:17,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:17,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:17,215 INFO [StoreOpener-28c8bcf12eaa484e59bd3772d519c1a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:17,217 DEBUG [StoreOpener-28c8bcf12eaa484e59bd3772d519c1a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf 2023-07-11 21:49:17,217 DEBUG [StoreOpener-28c8bcf12eaa484e59bd3772d519c1a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf 2023-07-11 21:49:17,220 INFO [StoreOpener-f4841c4786724783939b425cc0fcdf41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:17,221 INFO [StoreOpener-28c8bcf12eaa484e59bd3772d519c1a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28c8bcf12eaa484e59bd3772d519c1a9 columnFamilyName cf 2023-07-11 21:49:17,228 INFO [StoreOpener-28c8bcf12eaa484e59bd3772d519c1a9-1] regionserver.HStore(310): Store=28c8bcf12eaa484e59bd3772d519c1a9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:49:17,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:17,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:17,243 DEBUG [StoreOpener-f4841c4786724783939b425cc0fcdf41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf 2023-07-11 21:49:17,243 DEBUG [StoreOpener-f4841c4786724783939b425cc0fcdf41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf 2023-07-11 21:49:17,244 INFO [StoreOpener-f4841c4786724783939b425cc0fcdf41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4841c4786724783939b425cc0fcdf41 columnFamilyName cf 2023-07-11 21:49:17,246 INFO [StoreOpener-f4841c4786724783939b425cc0fcdf41-1] regionserver.HStore(310): Store=f4841c4786724783939b425cc0fcdf41/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:49:17,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:17,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:17,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:17,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:17,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:49:17,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:49:17,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened f4841c4786724783939b425cc0fcdf41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63214458, jitterRate=-0.058031171560287476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:49:17,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 28c8bcf12eaa484e59bd3772d519c1a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60716106, jitterRate=-0.09525951743125916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:49:17,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for f4841c4786724783939b425cc0fcdf41: 2023-07-11 21:49:17,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 28c8bcf12eaa484e59bd3772d519c1a9: 2023-07-11 21:49:17,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9., pid=60, masterSystemTime=1689112157205 2023-07-11 21:49:17,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41., pid=61, masterSystemTime=1689112157205 2023-07-11 21:49:17,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:17,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:17,283 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f4841c4786724783939b425cc0fcdf41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:17,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112157283"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112157283"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112157283"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112157283"}]},"ts":"1689112157283"} 2023-07-11 21:49:17,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:17,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:17,286 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=28c8bcf12eaa484e59bd3772d519c1a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:17,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112157286"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112157286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112157286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112157286"}]},"ts":"1689112157286"} 2023-07-11 21:49:17,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-11 21:49:17,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure f4841c4786724783939b425cc0fcdf41, server=jenkins-hbase17.apache.org,34193,1689112018101 in 252 msec 2023-07-11 21:49:17,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-11 21:49:17,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 28c8bcf12eaa484e59bd3772d519c1a9, server=jenkins-hbase17.apache.org,46731,1689112018018 in 256 msec 2023-07-11 21:49:17,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4841c4786724783939b425cc0fcdf41, ASSIGN in 426 msec 2023-07-11 21:49:17,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-11 21:49:17,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=28c8bcf12eaa484e59bd3772d519c1a9, ASSIGN in 431 msec 2023-07-11 21:49:17,312 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:49:17,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112157312"}]},"ts":"1689112157312"} 2023-07-11 21:49:17,314 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-11 21:49:17,380 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:49:17,381 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-11 21:49:17,383 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 21:49:17,489 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:17,489 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:17,490 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:17,490 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:17,653 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:17,654 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:17,654 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:17,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:17,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:17,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:17,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 1.8040 sec 2023-07-11 21:49:17,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 21:49:17,967 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-11 21:49:17,970 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:17,970 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:17,972 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:49:18,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 21:49:18,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112158014 (current time:1689112158014). 2023-07-11 21:49:18,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:49:18,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x2f6fdcb2 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:18,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ea10f27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:18,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:18,506 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:18,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f6fdcb2 to 127.0.0.1:59736 2023-07-11 21:49:18,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:18,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x0b905b02 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:19,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5acb8c8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:19,052 DEBUG [hconnection-0x4c8568c7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:19,055 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:19,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:19,082 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:19,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b905b02 to 127.0.0.1:59736 2023-07-11 21:49:19,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:19,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 21:49:19,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:49:19,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 21:49:19,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 21:49:19,092 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 21:49:19,095 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689112759095 2023-07-11 21:49:19,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 21:49:19,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,106 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 21:49:19,106 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:49:19,106 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:49:19,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 21:49:19,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 17 msec 2023-07-11 21:49:19,110 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 21:49:19,111 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689112759111 2023-07-11 21:49:19,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,171 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 21:49:19,171 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:19,173 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 21:49:19,173 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 21:49:19,181 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,181 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,206 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:19,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:19,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:19,209 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:49:19,210 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:19,210 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:19,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:19,210 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:19,210 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:19,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:19,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:19,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:19,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:19,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:19,212 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:19,212 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:19,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,214 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:19,214 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:49:19,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 21:49:19,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 21:49:19,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,218 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 21:49:19,218 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:19,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,218 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 21:49:19,220 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:19,220 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 21:49:19,220 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 21:49:19,220 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 21:49:19,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,223 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 21:49:19,223 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 21:49:19,223 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:19,223 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 21:49:19,224 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 21:49:19,225 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 21:49:19,225 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 21:49:19,225 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 21:49:19,409 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:19,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:19,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:19,411 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:49:19,473 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0004_000001 (auth:SIMPLE) 2023-07-11 21:49:19,712 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:19,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:19,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:19,713 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:49:19,726 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,873 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:19,873 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,873 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,873 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:19,886 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:19,886 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:19,886 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,887 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:19,889 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,889 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:19,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 21:49:19,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@784dcf84[Count = 1] remaining members to acquire global barrier 2023-07-11 21:49:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:19,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 21:49:19,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@784dcf84[Count = 0] remaining members to acquire global barrier 2023-07-11 21:49:19,896 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 21:49:19,896 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,959 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,959 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,959 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,960 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:19,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 21:49:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 21:49:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 21:49:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 21:49:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:49:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:19,960 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:19,960 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. started... 2023-07-11 21:49:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:19,961 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:19,960 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:19,962 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:19,962 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:49:19,962 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. started... 2023-07-11 21:49:19,963 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 28c8bcf12eaa484e59bd3772d519c1a9: 2023-07-11 21:49:19,963 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,963 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:19,963 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:49:19,964 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4841c4786724783939b425cc0fcdf41: 2023-07-11 21:49:19,964 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:19,964 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:19,964 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:49:19,980 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 21:49:19,980 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:19,980 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 21:49:20,072 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. completed. 2023-07-11 21:49:20,072 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:20,072 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:20,072 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:20,072 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,072 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 21:49:20,072 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:49:20,076 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:20,077 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 21:49:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:20,077 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:20,077 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. completed. 2023-07-11 21:49:20,077 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:20,077 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:20,077 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 21:49:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:20,077 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:20,078 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,078 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 21:49:20,078 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:49:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,081 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 21:49:20,082 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,082 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:20,082 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 21:49:20,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:20,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,46731,1689112018018': 2023-07-11 21:49:20,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 21:49:20,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:20,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:20,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:20,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:20,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:20,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:49:20,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 21:49:20,092 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 21:49:20,092 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:49:20,092 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:49:20,092 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,092 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:49:20,096 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,096 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,096 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-11 21:49:20,096 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:20,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,096 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:20,096 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,096 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:20,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,100 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:20,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:20,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:20,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:20,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:20,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:20,105 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:20,106 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,106 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,112 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,113 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,113 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,118 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:20,118 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:20,118 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:20,118 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:20,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:20,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:20,119 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:20,119 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,119 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:49:20,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:20,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,122 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:20,122 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:20,122 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,122 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:20,122 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:20,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:20,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:20,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:20,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:20,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:20,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:20,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:20,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 21:49:20,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,213 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:20,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:20,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:20,216 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 21:49:20,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,582 WARN [DataStreamer for file /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 21:49:20,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 21:49:20,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,704 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:20,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689112159096Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689112160197 (+1101 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689112160197Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689112160197Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689112160232 (+35 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689112160388 (+156 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689112160703 (+315 ms) 2023-07-11 21:49:20,709 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 21:49:20,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.6100 sec 2023-07-11 21:49:21,005 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:49:21,217 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:21,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:21,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:49:21,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46731] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:49:21,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34193] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:49:21,240 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,240 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:21,240 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:49:21,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 21:49:21,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112161291 (current time:1689112161291). 2023-07-11 21:49:21,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:49:21,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x5c115ede to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:21,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cdba0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:21,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:21,354 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:21,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c115ede to 127.0.0.1:59736 2023-07-11 21:49:21,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:21,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x480e72a0 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:21,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e3f32d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:21,476 DEBUG [hconnection-0x774bdeff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:21,482 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:21,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:21,497 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:21,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x480e72a0 to 127.0.0.1:59736 2023-07-11 21:49:21,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:21,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 21:49:21,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:49:21,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 21:49:21,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 21:49:21,504 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 21:49:21,506 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689112761506 2023-07-11 21:49:21,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 21:49:21,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,507 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:49:21,507 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:49:21,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 21:49:21,518 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 21:49:21,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 17 msec 2023-07-11 21:49:21,522 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 21:49:21,525 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689112761525 2023-07-11 21:49:21,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,595 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 21:49:21,595 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:21,598 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 21:49:21,598 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 21:49:21,603 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,604 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,606 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:21,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:21,606 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:21,607 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:21,607 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:21,607 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:21,607 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:21,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:21,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,607 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 21:49:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,608 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 21:49:21,608 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:21,608 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:49:21,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:21,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:21,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 21:49:21,609 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:49:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,609 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 21:49:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 21:49:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,610 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 21:49:21,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,631 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 21:49:21,631 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 21:49:21,631 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:21,631 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:21,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,633 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 21:49:21,662 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:21,663 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 21:49:21,663 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 21:49:21,663 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 21:49:21,663 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 21:49:21,663 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 21:49:21,663 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 21:49:21,665 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 21:49:21,666 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 21:49:21,666 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 21:49:21,667 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,667 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,668 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:21,669 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,670 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:21,670 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:21,671 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,671 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:21,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:21,673 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:21,674 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,674 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:21,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 21:49:21,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f569004[Count = 1] remaining members to acquire global barrier 2023-07-11 21:49:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:21,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 21:49:21,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f569004[Count = 0] remaining members to acquire global barrier 2023-07-11 21:49:21,679 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 21:49:21,679 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,680 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,680 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,681 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,681 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 21:49:21,681 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 21:49:21,681 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:49:21,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:21,681 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 21:49:21,682 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 21:49:21,682 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:21,682 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 21:49:21,682 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:21,683 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:21,683 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:49:21,684 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 21:49:21,705 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:21,717 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:21,717 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:21,717 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:21,717 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:21,717 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:21,717 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. started... 2023-07-11 21:49:21,717 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 28c8bcf12eaa484e59bd3772d519c1a9 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-11 21:49:21,718 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. started... 2023-07-11 21:49:21,719 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f4841c4786724783939b425cc0fcdf41 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-11 21:49:21,810 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:21,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:21,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:21,813 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:49:21,937 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307110b7031a98d6c477f9933cbd6731e10da to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307110b7031a98d6c477f9933cbd6731e10da 2023-07-11 21:49:21,939 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307117c0a9e3507774381849888f924737ff3 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307117c0a9e3507774381849888f924737ff3 2023-07-11 21:49:21,983 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/.tmp/cf/7a1d17598d8a48439852840ef56817b9 2023-07-11 21:49:21,983 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/.tmp/cf/546246ded56c493b999cf6d4c31bf728 2023-07-11 21:49:22,015 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/.tmp/cf/7a1d17598d8a48439852840ef56817b9 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf/7a1d17598d8a48439852840ef56817b9 2023-07-11 21:49:22,023 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/.tmp/cf/546246ded56c493b999cf6d4c31bf728 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf/546246ded56c493b999cf6d4c31bf728 2023-07-11 21:49:22,034 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf/7a1d17598d8a48439852840ef56817b9, entries=4, sequenceid=6, filesize=5.6 K 2023-07-11 21:49:22,034 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf/546246ded56c493b999cf6d4c31bf728, entries=46, sequenceid=6, filesize=13.4 K 2023-07-11 21:49:22,041 INFO [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 28c8bcf12eaa484e59bd3772d519c1a9 in 324ms, sequenceid=6, compaction requested=false 2023-07-11 21:49:22,043 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 28c8bcf12eaa484e59bd3772d519c1a9: 2023-07-11 21:49:22,044 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,047 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f4841c4786724783939b425cc0fcdf41 in 329ms, sequenceid=6, compaction requested=false 2023-07-11 21:49:22,048 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4841c4786724783939b425cc0fcdf41: 2023-07-11 21:49:22,050 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,050 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:22,050 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf/546246ded56c493b999cf6d4c31bf728] hfiles 2023-07-11 21:49:22,050 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf/546246ded56c493b999cf6d4c31bf728 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,050 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:22,050 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf/7a1d17598d8a48439852840ef56817b9] hfiles 2023-07-11 21:49:22,050 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf/7a1d17598d8a48439852840ef56817b9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,116 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:22,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:22,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:22,119 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:49:22,132 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. completed. 2023-07-11 21:49:22,133 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:22,133 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:22,133 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:22,133 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,148 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 21:49:22,148 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:49:22,149 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 21:49:22,149 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,149 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:22,150 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 21:49:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:22,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:49:22,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 21:49:22,173 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. completed. 2023-07-11 21:49:22,173 DEBUG [rs(jenkins-hbase17.apache.org,46731,1689112018018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:22,173 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:22,173 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:22,173 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,173 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 21:49:22,173 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:49:22,177 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 21:49:22,177 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:22,177 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 21:49:22,177 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:22,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:22,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:22,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:22,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:22,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,46731,1689112018018': 2023-07-11 21:49:22,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 21:49:22,184 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 21:49:22,184 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:49:22,184 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:49:22,184 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,184 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:49:22,186 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,186 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:22,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,186 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,187 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:22,186 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,186 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:22,187 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:22,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:22,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:22,188 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:22,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:22,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:22,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:22,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:22,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,189 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:22,190 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:22,192 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,192 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,193 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,197 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:22,197 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:22,197 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:22,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:22,197 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:22,197 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:22,197 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:22,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:22,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:22,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:22,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,198 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,198 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:22,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,198 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,201 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,201 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,201 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,201 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,201 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,201 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,201 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:22,201 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,202 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-11 21:49:22,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:22,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:22,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:22,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:22,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:22,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:49:22,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:22,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307117c0a9e3507774381849888f924737ff3, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307110b7031a98d6c477f9933cbd6731e10da] mob files 2023-07-11 21:49:22,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307117c0a9e3507774381849888f924737ff3 2023-07-11 21:49:22,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307110b7031a98d6c477f9933cbd6731e10da 2023-07-11 21:49:22,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 21:49:22,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,444 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:22,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689112161507Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689112162264 (+757 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689112162264Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689112162264Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689112162272 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689112162334 (+62 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689112162443 (+109 ms) 2023-07-11 21:49:22,453 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 21:49:22,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 945 msec 2023-07-11 21:49:22,621 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:22,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 21:49:22,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:49:22,669 DEBUG [Listener at jenkins-hbase17.apache.org/33347] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:49:22,673 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:49:22,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34193] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 21:49:22,676 DEBUG [Listener at jenkins-hbase17.apache.org/33347] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:49:22,693 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:49:22,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35055] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 21:49:22,695 DEBUG [Listener at jenkins-hbase17.apache.org/33347] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:49:22,705 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:49:22,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46731] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 21:49:22,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:49:22,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:22,715 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:49:22,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-11 21:49:22,717 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:49:22,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 21:49:22,730 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:22,734 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b empty. 2023-07-11 21:49:22,734 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:22,734 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd empty. 2023-07-11 21:49:22,734 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:22,735 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:22,735 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 21:49:22,759 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-11 21:49:22,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a776ed6719099e147a3d4cf78a48188b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:49:22,761 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 20515950b86456bee3d88ac9dc4061cd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:49:22,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:22,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 20515950b86456bee3d88ac9dc4061cd, disabling compactions & flushes 2023-07-11 21:49:22,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:22,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:22,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. after waiting 0 ms 2023-07-11 21:49:22,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:22,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:22,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 20515950b86456bee3d88ac9dc4061cd: 2023-07-11 21:49:22,793 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:22,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a776ed6719099e147a3d4cf78a48188b, disabling compactions & flushes 2023-07-11 21:49:22,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:22,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:22,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. after waiting 0 ms 2023-07-11 21:49:22,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:22,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:22,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a776ed6719099e147a3d4cf78a48188b: 2023-07-11 21:49:22,798 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:49:22,799 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112162799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112162799"}]},"ts":"1689112162799"} 2023-07-11 21:49:22,799 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112162799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112162799"}]},"ts":"1689112162799"} 2023-07-11 21:49:22,802 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:49:22,803 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:49:22,803 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112162803"}]},"ts":"1689112162803"} 2023-07-11 21:49:22,804 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-11 21:49:22,807 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:49:22,809 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:49:22,809 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:49:22,809 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:49:22,809 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:49:22,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a776ed6719099e147a3d4cf78a48188b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20515950b86456bee3d88ac9dc4061cd, ASSIGN}] 2023-07-11 21:49:22,820 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20515950b86456bee3d88ac9dc4061cd, ASSIGN 2023-07-11 21:49:22,821 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a776ed6719099e147a3d4cf78a48188b, ASSIGN 2023-07-11 21:49:22,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 21:49:22,828 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20515950b86456bee3d88ac9dc4061cd, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34193,1689112018101; forceNewPlan=false, retain=false 2023-07-11 21:49:22,829 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a776ed6719099e147a3d4cf78a48188b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35055,1689112018269; forceNewPlan=false, retain=false 2023-07-11 21:49:22,979 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:49:22,983 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a776ed6719099e147a3d4cf78a48188b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:22,983 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=20515950b86456bee3d88ac9dc4061cd, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:22,983 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112162983"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112162983"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112162983"}]},"ts":"1689112162983"} 2023-07-11 21:49:22,983 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112162983"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112162983"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112162983"}]},"ts":"1689112162983"} 2023-07-11 21:49:22,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure a776ed6719099e147a3d4cf78a48188b, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:49:22,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 20515950b86456bee3d88ac9dc4061cd, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:49:23,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 21:49:23,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:23,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a776ed6719099e147a3d4cf78a48188b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.', STARTKEY => '', ENDKEY => '2'} 2023-07-11 21:49:23,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. service=AccessControlService 2023-07-11 21:49:23,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:23,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:49:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20515950b86456bee3d88ac9dc4061cd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 21:49:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. service=AccessControlService 2023-07-11 21:49:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:49:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:23,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,167 INFO [StoreOpener-20515950b86456bee3d88ac9dc4061cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,172 INFO [StoreOpener-a776ed6719099e147a3d4cf78a48188b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,175 DEBUG [StoreOpener-20515950b86456bee3d88ac9dc4061cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf 2023-07-11 21:49:23,175 DEBUG [StoreOpener-a776ed6719099e147a3d4cf78a48188b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf 2023-07-11 21:49:23,175 DEBUG [StoreOpener-20515950b86456bee3d88ac9dc4061cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf 2023-07-11 21:49:23,175 DEBUG [StoreOpener-a776ed6719099e147a3d4cf78a48188b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf 2023-07-11 21:49:23,175 INFO [StoreOpener-a776ed6719099e147a3d4cf78a48188b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a776ed6719099e147a3d4cf78a48188b columnFamilyName cf 2023-07-11 21:49:23,175 INFO [StoreOpener-20515950b86456bee3d88ac9dc4061cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20515950b86456bee3d88ac9dc4061cd columnFamilyName cf 2023-07-11 21:49:23,176 INFO [StoreOpener-20515950b86456bee3d88ac9dc4061cd-1] regionserver.HStore(310): Store=20515950b86456bee3d88ac9dc4061cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:49:23,177 INFO [StoreOpener-a776ed6719099e147a3d4cf78a48188b-1] regionserver.HStore(310): Store=a776ed6719099e147a3d4cf78a48188b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:49:23,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:49:23,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:49:23,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 20515950b86456bee3d88ac9dc4061cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59900855, jitterRate=-0.10740770399570465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:49:23,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 20515950b86456bee3d88ac9dc4061cd: 2023-07-11 21:49:23,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a776ed6719099e147a3d4cf78a48188b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63575224, jitterRate=-0.05265533924102783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:49:23,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a776ed6719099e147a3d4cf78a48188b: 2023-07-11 21:49:23,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b., pid=69, masterSystemTime=1689112163141 2023-07-11 21:49:23,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd., pid=70, masterSystemTime=1689112163143 2023-07-11 21:49:23,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:23,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:23,217 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a776ed6719099e147a3d4cf78a48188b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:23,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:23,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:23,217 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112163217"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112163217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112163217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112163217"}]},"ts":"1689112163217"} 2023-07-11 21:49:23,219 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=20515950b86456bee3d88ac9dc4061cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:23,219 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112163218"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112163218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112163218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112163218"}]},"ts":"1689112163218"} 2023-07-11 21:49:23,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-11 21:49:23,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure a776ed6719099e147a3d4cf78a48188b, server=jenkins-hbase17.apache.org,35055,1689112018269 in 233 msec 2023-07-11 21:49:23,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-11 21:49:23,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 20515950b86456bee3d88ac9dc4061cd, server=jenkins-hbase17.apache.org,34193,1689112018101 in 235 msec 2023-07-11 21:49:23,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a776ed6719099e147a3d4cf78a48188b, ASSIGN in 421 msec 2023-07-11 21:49:23,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-11 21:49:23,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20515950b86456bee3d88ac9dc4061cd, ASSIGN in 431 msec 2023-07-11 21:49:23,256 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:49:23,256 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112163256"}]},"ts":"1689112163256"} 2023-07-11 21:49:23,258 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-11 21:49:23,261 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:49:23,262 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-11 21:49:23,265 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 21:49:23,267 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:23,267 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:23,268 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:23,268 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:23,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:23,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:23,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:23,271 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:23,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:23,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:23,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:23,272 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:23,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:23,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:23,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 564 msec 2023-07-11 21:49:23,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 21:49:23,333 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-11 21:49:23,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions a776ed6719099e147a3d4cf78a48188b, 20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a776ed6719099e147a3d4cf78a48188b, 20515950b86456bee3d88ac9dc4061cd], force=true 2023-07-11 21:49:23,410 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a776ed6719099e147a3d4cf78a48188b, 20515950b86456bee3d88ac9dc4061cd], force=true 2023-07-11 21:49:23,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 21:49:23,410 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a776ed6719099e147a3d4cf78a48188b, 20515950b86456bee3d88ac9dc4061cd], force=true 2023-07-11 21:49:23,410 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a776ed6719099e147a3d4cf78a48188b, 20515950b86456bee3d88ac9dc4061cd], force=true 2023-07-11 21:49:23,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a776ed6719099e147a3d4cf78a48188b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20515950b86456bee3d88ac9dc4061cd, UNASSIGN}] 2023-07-11 21:49:23,454 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a776ed6719099e147a3d4cf78a48188b, UNASSIGN 2023-07-11 21:49:23,455 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20515950b86456bee3d88ac9dc4061cd, UNASSIGN 2023-07-11 21:49:23,456 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=20515950b86456bee3d88ac9dc4061cd, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:23,456 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a776ed6719099e147a3d4cf78a48188b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:23,456 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112163456"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112163456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112163456"}]},"ts":"1689112163456"} 2023-07-11 21:49:23,456 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112163456"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112163456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112163456"}]},"ts":"1689112163456"} 2023-07-11 21:49:23,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 20515950b86456bee3d88ac9dc4061cd, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:49:23,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure a776ed6719099e147a3d4cf78a48188b, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:49:23,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 21:49:23,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a776ed6719099e147a3d4cf78a48188b, disabling compactions & flushes 2023-07-11 21:49:23,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:23,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:23,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. after waiting 0 ms 2023-07-11 21:49:23,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:23,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing a776ed6719099e147a3d4cf78a48188b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 21:49:23,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 20515950b86456bee3d88ac9dc4061cd, disabling compactions & flushes 2023-07-11 21:49:23,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:23,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:23,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. after waiting 0 ms 2023-07-11 21:49:23,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:23,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 20515950b86456bee3d88ac9dc4061cd 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 21:49:23,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/.tmp/cf/a18b88ebab98450181c725992f7a7395 2023-07-11 21:49:23,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/.tmp/cf/a18b88ebab98450181c725992f7a7395 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf/a18b88ebab98450181c725992f7a7395 2023-07-11 21:49:23,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 21:49:23,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf/a18b88ebab98450181c725992f7a7395, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 21:49:23,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 20515950b86456bee3d88ac9dc4061cd in 114ms, sequenceid=5, compaction requested=false 2023-07-11 21:49:23,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 21:49:23,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/.tmp/cf/77c87826f8f34ce1ad0e498d84978385 2023-07-11 21:49:23,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 21:49:23,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:49:23,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd. 2023-07-11 21:49:23,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 20515950b86456bee3d88ac9dc4061cd: 2023-07-11 21:49:23,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/.tmp/cf/77c87826f8f34ce1ad0e498d84978385 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf/77c87826f8f34ce1ad0e498d84978385 2023-07-11 21:49:23,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:23,796 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=20515950b86456bee3d88ac9dc4061cd, regionState=CLOSED 2023-07-11 21:49:23,799 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112163796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112163796"}]},"ts":"1689112163796"} 2023-07-11 21:49:23,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf/77c87826f8f34ce1ad0e498d84978385, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 21:49:23,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-11 21:49:23,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a776ed6719099e147a3d4cf78a48188b in 191ms, sequenceid=5, compaction requested=false 2023-07-11 21:49:23,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 20515950b86456bee3d88ac9dc4061cd, server=jenkins-hbase17.apache.org,34193,1689112018101 in 346 msec 2023-07-11 21:49:23,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20515950b86456bee3d88ac9dc4061cd, UNASSIGN in 367 msec 2023-07-11 21:49:23,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 21:49:23,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:49:23,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b. 2023-07-11 21:49:23,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a776ed6719099e147a3d4cf78a48188b: 2023-07-11 21:49:23,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:23,857 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a776ed6719099e147a3d4cf78a48188b, regionState=CLOSED 2023-07-11 21:49:23,857 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112163857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112163857"}]},"ts":"1689112163857"} 2023-07-11 21:49:23,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-11 21:49:23,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure a776ed6719099e147a3d4cf78a48188b, server=jenkins-hbase17.apache.org,35055,1689112018269 in 399 msec 2023-07-11 21:49:23,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-11 21:49:23,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a776ed6719099e147a3d4cf78a48188b, UNASSIGN in 417 msec 2023-07-11 21:49:24,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 21:49:24,038 WARN [DataStreamer for file /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/.merges/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/a18b88ebab98450181c725992f7a7395.20515950b86456bee3d88ac9dc4061cd] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 21:49:24,171 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-11 21:49:24,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162708.a776ed6719099e147a3d4cf78a48188b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:24,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112162708.20515950b86456bee3d88ac9dc4061cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:24,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:24,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7220d9a3c6b36ab2266d7d0e0b008f6b, ASSIGN}] 2023-07-11 21:49:24,266 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7220d9a3c6b36ab2266d7d0e0b008f6b, ASSIGN 2023-07-11 21:49:24,270 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7220d9a3c6b36ab2266d7d0e0b008f6b, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,35055,1689112018269; forceNewPlan=false, retain=false 2023-07-11 21:49:24,421 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 21:49:24,424 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7220d9a3c6b36ab2266d7d0e0b008f6b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:24,424 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689112164424"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112164424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112164424"}]},"ts":"1689112164424"} 2023-07-11 21:49:24,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 7220d9a3c6b36ab2266d7d0e0b008f6b, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:49:24,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 21:49:24,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:24,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7220d9a3c6b36ab2266d7d0e0b008f6b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:49:24,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. service=AccessControlService 2023-07-11 21:49:24,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:49:24,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:24,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:24,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:24,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:24,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/.regioninfo 2023-07-11 21:49:25,065 INFO [StoreOpener-7220d9a3c6b36ab2266d7d0e0b008f6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:25,066 DEBUG [StoreOpener-7220d9a3c6b36ab2266d7d0e0b008f6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf 2023-07-11 21:49:25,066 DEBUG [StoreOpener-7220d9a3c6b36ab2266d7d0e0b008f6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf 2023-07-11 21:49:25,067 INFO [StoreOpener-7220d9a3c6b36ab2266d7d0e0b008f6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7220d9a3c6b36ab2266d7d0e0b008f6b columnFamilyName cf 2023-07-11 21:49:25,110 DEBUG [StoreOpener-7220d9a3c6b36ab2266d7d0e0b008f6b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/77c87826f8f34ce1ad0e498d84978385.a776ed6719099e147a3d4cf78a48188b->hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf/77c87826f8f34ce1ad0e498d84978385-top 2023-07-11 21:49:25,117 DEBUG [StoreOpener-7220d9a3c6b36ab2266d7d0e0b008f6b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/a18b88ebab98450181c725992f7a7395.20515950b86456bee3d88ac9dc4061cd->hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf/a18b88ebab98450181c725992f7a7395-top 2023-07-11 21:49:25,117 INFO [StoreOpener-7220d9a3c6b36ab2266d7d0e0b008f6b-1] regionserver.HStore(310): Store=7220d9a3c6b36ab2266d7d0e0b008f6b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:49:25,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:25,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:25,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:25,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 7220d9a3c6b36ab2266d7d0e0b008f6b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68084239, jitterRate=0.014534220099449158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:49:25,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 7220d9a3c6b36ab2266d7d0e0b008f6b: 2023-07-11 21:49:25,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b., pid=77, masterSystemTime=1689112164586 2023-07-11 21:49:25,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.,because compaction is disabled. 2023-07-11 21:49:25,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:25,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:25,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7220d9a3c6b36ab2266d7d0e0b008f6b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,130 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689112165129"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112165129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112165129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112165129"}]},"ts":"1689112165129"} 2023-07-11 21:49:25,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-11 21:49:25,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 7220d9a3c6b36ab2266d7d0e0b008f6b, server=jenkins-hbase17.apache.org,35055,1689112018269 in 700 msec 2023-07-11 21:49:25,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-11 21:49:25,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7220d9a3c6b36ab2266d7d0e0b008f6b, ASSIGN in 889 msec 2023-07-11 21:49:25,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a776ed6719099e147a3d4cf78a48188b, 20515950b86456bee3d88ac9dc4061cd], force=true in 1.7670 sec 2023-07-11 21:49:25,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 21:49:25,519 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-11 21:49:25,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 21:49:25,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112165520 (current time:1689112165520). 2023-07-11 21:49:25,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:49:25,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x56af4d75 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:25,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bc0b808, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:25,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:25,560 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:25,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56af4d75 to 127.0.0.1:59736 2023-07-11 21:49:25,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:25,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x3851d7a5 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:25,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1439f13f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:25,698 DEBUG [hconnection-0x6a471b48-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:25,710 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:25,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:25,724 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:25,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3851d7a5 to 127.0.0.1:59736 2023-07-11 21:49:25,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:25,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 21:49:25,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:49:25,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 21:49:25,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 21:49:25,740 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 21:49:25,741 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689112765741 2023-07-11 21:49:25,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 21:49:25,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,748 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:49:25,749 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:49:25,752 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 21:49:25,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 21:49:25,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 15 msec 2023-07-11 21:49:25,757 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 21:49:25,758 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689112765758 2023-07-11 21:49:25,852 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:25,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,852 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 21:49:25,852 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:25,854 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-11 21:49:25,854 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-11 21:49:25,855 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 21:49:25,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:25,855 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,855 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:49:25,856 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:25,856 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:25,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:25,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:25,856 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:25,856 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,857 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,857 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:49:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 21:49:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 21:49:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 21:49:25,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 21:49:25,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,860 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 21:49:25,860 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 21:49:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,864 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 21:49:25,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,865 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 21:49:25,865 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:25,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,869 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 21:49:25,870 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 21:49:25,870 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:25,869 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 21:49:25,870 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 21:49:25,870 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 21:49:25,872 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 21:49:25,872 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 21:49:25,872 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 21:49:25,871 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 21:49:25,872 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 21:49:25,874 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:25,874 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,874 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,875 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,875 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:25,875 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,875 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:25,878 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:25,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:25,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-11 21:49:25,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@183e6b59[Count = 0] remaining members to acquire global barrier 2023-07-11 21:49:25,885 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-11 21:49:25,885 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,886 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,887 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:49:25,887 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 21:49:25,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:25,887 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 21:49:25,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,887 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 21:49:25,887 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 21:49:25,888 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:49:25,888 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 21:49:25,888 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:49:25,891 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:25,891 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:25,891 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:25,891 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. started... 2023-07-11 21:49:25,893 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7220d9a3c6b36ab2266d7d0e0b008f6b: 2023-07-11 21:49:25,893 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,893 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:25,894 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/77c87826f8f34ce1ad0e498d84978385.a776ed6719099e147a3d4cf78a48188b->hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf/77c87826f8f34ce1ad0e498d84978385-top, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/a18b88ebab98450181c725992f7a7395.20515950b86456bee3d88ac9dc4061cd->hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf/a18b88ebab98450181c725992f7a7395-top] hfiles 2023-07-11 21:49:25,894 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/77c87826f8f34ce1ad0e498d84978385.a776ed6719099e147a3d4cf78a48188b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,894 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 21:49:25,896 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:25,896 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 21:49:25,897 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/a18b88ebab98450181c725992f7a7395.20515950b86456bee3d88ac9dc4061cd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,900 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 21:49:25,900 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:25,901 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 21:49:25,938 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. completed. 2023-07-11 21:49:25,938 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:25,938 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:25,938 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:25,938 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,938 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 21:49:25,938 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:49:25,943 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,943 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 21:49:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:25,943 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:25,944 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 21:49:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:25,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:49:25,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-11 21:49:25,952 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-11 21:49:25,952 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:49:25,952 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:49:25,952 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,952 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:49:25,954 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,954 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,954 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,954 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,954 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:25,954 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:25,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:25,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,954 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:25,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:25,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,956 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,957 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:25,957 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:25,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,960 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,962 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:25,963 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,968 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:25,968 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:25,968 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:25,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:25,968 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:25,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:25,968 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:25,968 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:25,968 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:25,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:25,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:25,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:25,968 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:25,970 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,971 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,971 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:25,971 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:25,971 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,971 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:25,971 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:25,971 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,971 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,971 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:25,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:25,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-11 21:49:25,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:26,057 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:26,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 21:49:26,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:26,061 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:49:26,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:26,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-11 21:49:26,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:26,252 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:26,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689112165743Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689112165974 (+231 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689112165974Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689112165987 (+13 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689112166083 (+96 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689112166251 (+168 ms) 2023-07-11 21:49:26,257 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 21:49:26,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 509 msec 2023-07-11 21:49:26,361 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:26,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 21:49:26,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:49:26,364 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364 2023-07-11 21:49:26,364 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:37147, tgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364, rawTgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364, srcFsUri=hdfs://localhost.localdomain:37147, srcDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:49:26,390 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:49:26,390 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-299635683_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:26,390 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e, snapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-11 21:49:26,402 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:26,550 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:26,551 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:26,551 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:26,552 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,542 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-128449906414236393.jar 2023-07-11 21:49:27,543 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,543 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,625 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-6545193019981548892.jar 2023-07-11 21:49:27,626 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,626 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,627 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,627 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,628 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,629 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:27,629 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:49:27,630 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:49:27,630 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:49:27,631 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:49:27,631 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:49:27,632 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:49:27,632 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:49:27,633 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:49:27,633 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:49:27,634 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:49:27,635 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:49:27,636 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:49:27,637 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:49:27,638 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:49:27,638 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:49:27,639 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:49:27,640 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:49:28,652 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:49:30,237 WARN [Listener at jenkins-hbase17.apache.org/33347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:49:30,257 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-11 21:49:30,270 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-11 21:49:30,589 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:49:30,589 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:49:30,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0005_000001 (auth:SIMPLE) 2023-07-11 21:49:42,358 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0005_000001 (auth:SIMPLE) 2023-07-11 21:49:44,644 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0005_000001 (auth:SIMPLE) 2023-07-11 21:49:49,550 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0005_000001 (auth:SIMPLE) 2023-07-11 21:49:49,561 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689112033037_0005_01_000002 is : 143 2023-07-11 21:49:51,029 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:49:51,049 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:49:51,109 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,109 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:49:51,110 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:49:51,111 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,111 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 21:49:51,111 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 21:49:51,112 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,114 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 21:49:51,114 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112166364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 21:49:51,131 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 21:49:51,151 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112191151"}]},"ts":"1689112191151"} 2023-07-11 21:49:51,153 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-11 21:49:51,154 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-11 21:49:51,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7220d9a3c6b36ab2266d7d0e0b008f6b, UNASSIGN}] 2023-07-11 21:49:51,156 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7220d9a3c6b36ab2266d7d0e0b008f6b, UNASSIGN 2023-07-11 21:49:51,157 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7220d9a3c6b36ab2266d7d0e0b008f6b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:51,158 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689112191157"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112191157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112191157"}]},"ts":"1689112191157"} 2023-07-11 21:49:51,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 7220d9a3c6b36ab2266d7d0e0b008f6b, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:49:51,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 21:49:51,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:51,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 7220d9a3c6b36ab2266d7d0e0b008f6b, disabling compactions & flushes 2023-07-11 21:49:51,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:51,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:51,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. after waiting 0 ms 2023-07-11 21:49:51,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:51,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-11 21:49:51,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:49:51,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b. 2023-07-11 21:49:51,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 7220d9a3c6b36ab2266d7d0e0b008f6b: 2023-07-11 21:49:51,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:51,392 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7220d9a3c6b36ab2266d7d0e0b008f6b, regionState=CLOSED 2023-07-11 21:49:51,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689112191392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112191392"}]},"ts":"1689112191392"} 2023-07-11 21:49:51,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-11 21:49:51,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 7220d9a3c6b36ab2266d7d0e0b008f6b, server=jenkins-hbase17.apache.org,35055,1689112018269 in 236 msec 2023-07-11 21:49:51,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-11 21:49:51,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7220d9a3c6b36ab2266d7d0e0b008f6b, UNASSIGN in 247 msec 2023-07-11 21:49:51,414 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112191414"}]},"ts":"1689112191414"} 2023-07-11 21:49:51,416 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-11 21:49:51,419 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-11 21:49:51,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 290 msec 2023-07-11 21:49:51,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 21:49:51,453 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-11 21:49:51,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,462 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,463 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,464 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,467 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,467 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,467 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 21:49:51,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 21:49:51,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 21:49:51,469 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,469 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,469 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:51,469 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,469 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:51,469 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:51,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:51,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:51,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 21:49:51,470 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:51,472 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,472 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:51,472 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:51,472 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:51,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-11 21:49:51,472 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:51,472 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 21:49:51,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:51,477 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/recovered.edits] 2023-07-11 21:49:51,479 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/recovered.edits] 2023-07-11 21:49:51,479 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/recovered.edits] 2023-07-11 21:49:51,485 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/77c87826f8f34ce1ad0e498d84978385.a776ed6719099e147a3d4cf78a48188b to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/77c87826f8f34ce1ad0e498d84978385.a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:51,489 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/a18b88ebab98450181c725992f7a7395.20515950b86456bee3d88ac9dc4061cd to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/cf/a18b88ebab98450181c725992f7a7395.20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:51,489 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf/77c87826f8f34ce1ad0e498d84978385 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/cf/77c87826f8f34ce1ad0e498d84978385 2023-07-11 21:49:51,491 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf/a18b88ebab98450181c725992f7a7395 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/cf/a18b88ebab98450181c725992f7a7395 2023-07-11 21:49:51,501 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/recovered.edits/8.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd/recovered.edits/8.seqid 2023-07-11 21:49:51,504 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20515950b86456bee3d88ac9dc4061cd 2023-07-11 21:49:51,505 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/recovered.edits/8.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b/recovered.edits/8.seqid 2023-07-11 21:49:51,507 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/recovered.edits/12.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b/recovered.edits/12.seqid 2023-07-11 21:49:51,509 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a776ed6719099e147a3d4cf78a48188b 2023-07-11 21:49:51,509 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7220d9a3c6b36ab2266d7d0e0b008f6b 2023-07-11 21:49:51,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 21:49:51,516 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,524 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-11 21:49:51,537 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-11 21:49:51,543 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,544 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-11 21:49:51,544 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112191544"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:51,555 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 21:49:51,555 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7220d9a3c6b36ab2266d7d0e0b008f6b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112162709.7220d9a3c6b36ab2266d7d0e0b008f6b.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 21:49:51,555 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-11 21:49:51,555 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112191555"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:51,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 21:49:51,584 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-11 21:49:51,586 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:51,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 132 msec 2023-07-11 21:49:51,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 21:49:51,772 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-11 21:49:51,773 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:51,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:51,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:51,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 21:49:51,778 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112191778"}]},"ts":"1689112191778"} 2023-07-11 21:49:51,780 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-11 21:49:51,781 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-11 21:49:51,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=28c8bcf12eaa484e59bd3772d519c1a9, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4841c4786724783939b425cc0fcdf41, UNASSIGN}] 2023-07-11 21:49:51,785 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=28c8bcf12eaa484e59bd3772d519c1a9, UNASSIGN 2023-07-11 21:49:51,785 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4841c4786724783939b425cc0fcdf41, UNASSIGN 2023-07-11 21:49:51,786 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f4841c4786724783939b425cc0fcdf41, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:51,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=28c8bcf12eaa484e59bd3772d519c1a9, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:51,786 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112191786"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112191786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112191786"}]},"ts":"1689112191786"} 2023-07-11 21:49:51,786 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112191786"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112191786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112191786"}]},"ts":"1689112191786"} 2023-07-11 21:49:51,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure f4841c4786724783939b425cc0fcdf41, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:49:51,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 28c8bcf12eaa484e59bd3772d519c1a9, server=jenkins-hbase17.apache.org,46731,1689112018018}] 2023-07-11 21:49:51,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 21:49:51,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:51,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing f4841c4786724783939b425cc0fcdf41, disabling compactions & flushes 2023-07-11 21:49:51,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:51,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:51,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. after waiting 0 ms 2023-07-11 21:49:51,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:51,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:51,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 28c8bcf12eaa484e59bd3772d519c1a9, disabling compactions & flushes 2023-07-11 21:49:51,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:51,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:51,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. after waiting 0 ms 2023-07-11 21:49:51,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:52,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:49:52,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:49:52,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:49:52,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41. 2023-07-11 21:49:52,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for f4841c4786724783939b425cc0fcdf41: 2023-07-11 21:49:52,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:49:52,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:52,039 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f4841c4786724783939b425cc0fcdf41, regionState=CLOSED 2023-07-11 21:49:52,039 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112192039"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112192039"}]},"ts":"1689112192039"} 2023-07-11 21:49:52,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9. 2023-07-11 21:49:52,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 28c8bcf12eaa484e59bd3772d519c1a9: 2023-07-11 21:49:52,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:52,050 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=28c8bcf12eaa484e59bd3772d519c1a9, regionState=CLOSED 2023-07-11 21:49:52,050 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112192049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112192049"}]},"ts":"1689112192049"} 2023-07-11 21:49:52,053 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-11 21:49:52,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure f4841c4786724783939b425cc0fcdf41, server=jenkins-hbase17.apache.org,34193,1689112018101 in 258 msec 2023-07-11 21:49:52,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4841c4786724783939b425cc0fcdf41, UNASSIGN in 272 msec 2023-07-11 21:49:52,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-11 21:49:52,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 28c8bcf12eaa484e59bd3772d519c1a9, server=jenkins-hbase17.apache.org,46731,1689112018018 in 263 msec 2023-07-11 21:49:52,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-11 21:49:52,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=28c8bcf12eaa484e59bd3772d519c1a9, UNASSIGN in 281 msec 2023-07-11 21:49:52,070 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112192070"}]},"ts":"1689112192070"} 2023-07-11 21:49:52,074 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-11 21:49:52,077 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-11 21:49:52,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 21:49:52,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 305 msec 2023-07-11 21:49:52,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 21:49:52,382 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-11 21:49:52,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,387 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,388 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,389 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,390 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,390 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,390 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 21:49:52,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 21:49:52,391 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 21:49:52,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 21:49:52,395 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,395 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:52,395 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,395 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,396 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:52,395 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,396 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:52,396 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:52,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 21:49:52,413 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:52,416 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:52,418 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/recovered.edits] 2023-07-11 21:49:52,419 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/recovered.edits] 2023-07-11 21:49:52,432 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf/7a1d17598d8a48439852840ef56817b9 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/cf/7a1d17598d8a48439852840ef56817b9 2023-07-11 21:49:52,438 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf/546246ded56c493b999cf6d4c31bf728 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/cf/546246ded56c493b999cf6d4c31bf728 2023-07-11 21:49:52,442 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9/recovered.edits/9.seqid 2023-07-11 21:49:52,445 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/28c8bcf12eaa484e59bd3772d519c1a9 2023-07-11 21:49:52,450 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41/recovered.edits/9.seqid 2023-07-11 21:49:52,453 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4841c4786724783939b425cc0fcdf41 2023-07-11 21:49:52,453 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 21:49:52,457 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-11 21:49:52,458 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-11 21:49:52,467 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307117c0a9e3507774381849888f924737ff3 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307117c0a9e3507774381849888f924737ff3 2023-07-11 21:49:52,471 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307110b7031a98d6c477f9933cbd6731e10da to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307110b7031a98d6c477f9933cbd6731e10da 2023-07-11 21:49:52,471 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-11 21:49:52,477 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,495 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-11 21:49:52,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 21:49:52,502 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-11 21:49:52,504 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,504 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-11 21:49:52,504 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112192504"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:52,504 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112192504"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:52,506 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 21:49:52,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 28c8bcf12eaa484e59bd3772d519c1a9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689112155848.28c8bcf12eaa484e59bd3772d519c1a9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f4841c4786724783939b425cc0fcdf41, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112155848.f4841c4786724783939b425cc0fcdf41.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 21:49:52,507 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-11 21:49:52,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112192507"}]},"ts":"9223372036854775807"} 2023-07-11 21:49:52,508 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-11 21:49:52,510 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 128 msec 2023-07-11 21:49:52,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 21:49:52,704 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-11 21:49:52,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 21:49:52,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 21:49:52,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 21:49:52,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-11 21:49:52,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 21:49:52,811 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756 (was 743) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:43018 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:39530 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to jenkins-hbase17.apache.org/136.243.18.41:39669 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4130 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1257489681_1 at /127.0.0.1:39494 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:59146 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to jenkins-hbase17.apache.org/136.243.18.41:33347 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=916 (was 886) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1522 (was 1630), ProcessCount=190 (was 195), AvailableMemoryMB=1167 (was 927) - AvailableMemoryMB LEAK? - 2023-07-11 21:49:52,811 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-11 21:49:52,842 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=756, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=1522, ProcessCount=190, AvailableMemoryMB=1166 2023-07-11 21:49:52,842 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-11 21:49:52,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 21:49:52,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 21:49:52,854 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:49:52,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-11 21:49:52,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 21:49:52,860 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:49:52,873 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:52,874 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:52,874 DEBUG [HFileArchiver-24] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a empty. 2023-07-11 21:49:52,875 DEBUG [HFileArchiver-25] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db empty. 2023-07-11 21:49:52,875 DEBUG [HFileArchiver-24] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:52,875 DEBUG [HFileArchiver-25] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:52,875 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 21:49:52,943 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 21:49:52,949 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3af291080617f6b9cf945a17084ff20a, NAME => 'testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:49:52,953 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 02d1275169db3eb6a43ce616bf7496db, NAME => 'testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:49:52,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 21:49:53,058 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:53,062 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3af291080617f6b9cf945a17084ff20a, disabling compactions & flushes 2023-07-11 21:49:53,062 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:53,062 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:53,062 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. after waiting 0 ms 2023-07-11 21:49:53,062 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:53,062 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:53,062 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3af291080617f6b9cf945a17084ff20a: 2023-07-11 21:49:53,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:53,065 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 02d1275169db3eb6a43ce616bf7496db, disabling compactions & flushes 2023-07-11 21:49:53,065 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:53,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:53,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. after waiting 0 ms 2023-07-11 21:49:53,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:53,066 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:53,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 02d1275169db3eb6a43ce616bf7496db: 2023-07-11 21:49:53,068 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:49:53,069 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112193069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112193069"}]},"ts":"1689112193069"} 2023-07-11 21:49:53,069 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112193069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112193069"}]},"ts":"1689112193069"} 2023-07-11 21:49:53,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:49:53,072 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:49:53,072 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112193072"}]},"ts":"1689112193072"} 2023-07-11 21:49:53,073 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 21:49:53,075 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:49:53,076 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:49:53,076 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:49:53,076 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:49:53,076 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:49:53,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3af291080617f6b9cf945a17084ff20a, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=02d1275169db3eb6a43ce616bf7496db, ASSIGN}] 2023-07-11 21:49:53,081 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3af291080617f6b9cf945a17084ff20a, ASSIGN 2023-07-11 21:49:53,081 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=02d1275169db3eb6a43ce616bf7496db, ASSIGN 2023-07-11 21:49:53,083 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3af291080617f6b9cf945a17084ff20a, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34193,1689112018101; forceNewPlan=false, retain=false 2023-07-11 21:49:53,083 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=02d1275169db3eb6a43ce616bf7496db, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35055,1689112018269; forceNewPlan=false, retain=false 2023-07-11 21:49:53,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 21:49:53,233 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:49:53,237 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3af291080617f6b9cf945a17084ff20a, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:53,237 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=02d1275169db3eb6a43ce616bf7496db, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:53,237 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112193237"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112193237"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112193237"}]},"ts":"1689112193237"} 2023-07-11 21:49:53,237 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112193237"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112193237"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112193237"}]},"ts":"1689112193237"} 2023-07-11 21:49:53,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 3af291080617f6b9cf945a17084ff20a, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:49:53,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 02d1275169db3eb6a43ce616bf7496db, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:49:53,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3af291080617f6b9cf945a17084ff20a, NAME => 'testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:49:53,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02d1275169db3eb6a43ce616bf7496db, NAME => 'testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. service=AccessControlService 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. service=AccessControlService 2023-07-11 21:49:53,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:49:53,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:53,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:53,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:53,413 INFO [StoreOpener-02d1275169db3eb6a43ce616bf7496db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:53,420 INFO [StoreOpener-3af291080617f6b9cf945a17084ff20a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:53,421 DEBUG [StoreOpener-02d1275169db3eb6a43ce616bf7496db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf 2023-07-11 21:49:53,421 DEBUG [StoreOpener-02d1275169db3eb6a43ce616bf7496db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf 2023-07-11 21:49:53,422 INFO [StoreOpener-02d1275169db3eb6a43ce616bf7496db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02d1275169db3eb6a43ce616bf7496db columnFamilyName cf 2023-07-11 21:49:53,423 DEBUG [StoreOpener-3af291080617f6b9cf945a17084ff20a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf 2023-07-11 21:49:53,423 DEBUG [StoreOpener-3af291080617f6b9cf945a17084ff20a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf 2023-07-11 21:49:53,423 INFO [StoreOpener-3af291080617f6b9cf945a17084ff20a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3af291080617f6b9cf945a17084ff20a columnFamilyName cf 2023-07-11 21:49:53,424 INFO [StoreOpener-3af291080617f6b9cf945a17084ff20a-1] regionserver.HStore(310): Store=3af291080617f6b9cf945a17084ff20a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:49:53,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:53,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:53,429 INFO [StoreOpener-02d1275169db3eb6a43ce616bf7496db-1] regionserver.HStore(310): Store=02d1275169db3eb6a43ce616bf7496db/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:49:53,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:53,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:53,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 3af291080617f6b9cf945a17084ff20a 2023-07-11 21:49:53,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:49:53,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:49:53,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:49:53,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 3af291080617f6b9cf945a17084ff20a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66058789, jitterRate=-0.015647336840629578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:49:53,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 3af291080617f6b9cf945a17084ff20a: 2023-07-11 21:49:53,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 02d1275169db3eb6a43ce616bf7496db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69286809, jitterRate=0.032453909516334534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:49:53,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 02d1275169db3eb6a43ce616bf7496db: 2023-07-11 21:49:53,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db., pid=94, masterSystemTime=1689112193394 2023-07-11 21:49:53,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 21:49:53,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a., pid=93, masterSystemTime=1689112193393 2023-07-11 21:49:53,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:53,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:53,479 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=02d1275169db3eb6a43ce616bf7496db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:53,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:53,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:53,479 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112193478"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112193478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112193478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112193478"}]},"ts":"1689112193478"} 2023-07-11 21:49:53,479 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3af291080617f6b9cf945a17084ff20a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:53,480 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112193479"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112193479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112193479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112193479"}]},"ts":"1689112193479"} 2023-07-11 21:49:53,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-11 21:49:53,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 02d1275169db3eb6a43ce616bf7496db, server=jenkins-hbase17.apache.org,35055,1689112018269 in 239 msec 2023-07-11 21:49:53,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-11 21:49:53,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 3af291080617f6b9cf945a17084ff20a, server=jenkins-hbase17.apache.org,34193,1689112018101 in 241 msec 2023-07-11 21:49:53,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=02d1275169db3eb6a43ce616bf7496db, ASSIGN in 409 msec 2023-07-11 21:49:53,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-11 21:49:53,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3af291080617f6b9cf945a17084ff20a, ASSIGN in 409 msec 2023-07-11 21:49:53,499 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:49:53,499 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112193499"}]},"ts":"1689112193499"} 2023-07-11 21:49:53,501 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 21:49:53,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:49:53,506 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-11 21:49:53,508 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:49:53,509 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:53,510 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:53,510 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:53,510 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:49:53,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:53,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:53,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:53,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:49:53,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 663 msec 2023-07-11 21:49:53,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 21:49:53,966 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-11 21:49:53,972 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-11 21:49:53,972 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:53,974 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:49:53,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:49:53,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112193992 (current time:1689112193992). 2023-07-11 21:49:53,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:49:53,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x105c2cd5 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:54,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19f75aee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:54,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:54,015 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:54,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x105c2cd5 to 127.0.0.1:59736 2023-07-11 21:49:54,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:54,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x6c330d23 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:54,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1df8bef4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:54,035 DEBUG [hconnection-0x3efba78f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:54,040 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:54,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:54,045 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:54,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c330d23 to 127.0.0.1:59736 2023-07-11 21:49:54,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:54,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:49:54,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:49:54,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:49:54,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:49:54,051 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:49:54,052 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689112794052 2023-07-11 21:49:54,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 21:49:54,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:49:54,054 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:49:54,054 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:49:54,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 21:49:54,059 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:49:54,060 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-11 21:49:54,064 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 21:49:54,064 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689112794064 2023-07-11 21:49:54,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,097 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-11 21:49:54,097 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:54,098 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 21:49:54,098 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 21:49:54,100 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,101 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,103 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,103 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,103 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,103 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,104 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,104 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,104 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,104 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 21:49:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 21:49:54,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,105 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 21:49:54,105 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:54,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 21:49:54,107 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 21:49:54,107 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 21:49:54,107 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 21:49:54,108 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 21:49:54,107 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 21:49:54,109 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 21:49:54,109 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 21:49:54,109 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 21:49:54,111 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:54,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:54,111 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,111 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,111 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,111 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:54,112 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,112 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:54,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:54,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:54,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:54,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 21:49:54,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dbc8e06[Count = 1] remaining members to acquire global barrier 2023-07-11 21:49:54,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,116 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 21:49:54,116 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:54,118 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 21:49:54,118 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 21:49:54,118 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 21:49:54,119 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,119 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:54,119 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,119 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:54,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:54,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 21:49:54,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dbc8e06[Count = 0] remaining members to acquire global barrier 2023-07-11 21:49:54,122 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 21:49:54,122 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,124 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,125 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,125 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:49:54,125 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,125 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:49:54,125 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:54,125 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:54,125 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:54,125 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:54,125 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:54,125 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. started... 2023-07-11 21:49:54,125 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3af291080617f6b9cf945a17084ff20a: 2023-07-11 21:49:54,126 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,126 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:54,126 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:49:54,126 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,126 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:49:54,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,126 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:49:54,126 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 21:49:54,126 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:49:54,128 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:54,128 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. started... 2023-07-11 21:49:54,128 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 21:49:54,128 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:54,131 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 21:49:54,131 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02d1275169db3eb6a43ce616bf7496db: 2023-07-11 21:49:54,133 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,133 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:54,133 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:49:54,143 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. completed. 2023-07-11 21:49:54,143 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:54,143 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:54,143 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:54,143 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,143 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 21:49:54,143 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:49:54,145 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. completed. 2023-07-11 21:49:54,146 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:54,146 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:54,146 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:54,146 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,146 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 21:49:54,146 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:49:54,146 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 21:49:54,146 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,146 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,146 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 21:49:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:54,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:54,149 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,149 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 21:49:54,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:54,149 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:54,149 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 21:49:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:49:54,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 21:49:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,154 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:54,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:49:54,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,155 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:49:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:54,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:49:54,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 21:49:54,158 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 21:49:54,158 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:49:54,158 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:49:54,158 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,158 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:49:54,159 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,159 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,159 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:54,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,159 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:54,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,159 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,160 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:54,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,161 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:54,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:54,161 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:54,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:54,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:54,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:54,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:54,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:54,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:54,162 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,162 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:54,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,164 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:54,164 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,165 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,168 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,168 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,168 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,168 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:54,168 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,168 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,168 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:54,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,169 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:54,169 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:54,169 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,169 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:54,170 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:54,169 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-11 21:49:54,171 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:54,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:54,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:49:54,171 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,171 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,171 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,171 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,171 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,171 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 21:49:54,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 21:49:54,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,251 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689112194052Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689112194181 (+129 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689112194182 (+1 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689112194182Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689112194192 (+10 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689112194209 (+17 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689112194250 (+41 ms) 2023-07-11 21:49:54,256 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 21:49:54,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 202 msec 2023-07-11 21:49:54,355 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:54,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:49:54,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:49:54,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34193] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:49:54,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35055] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:49:54,380 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-11 21:49:54,380 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:54,380 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:49:54,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:49:54,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112194398 (current time:1689112194398). 2023-07-11 21:49:54,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:49:54,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x55427c2b to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:54,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36e66ed3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:54,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:54,435 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:54,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55427c2b to 127.0.0.1:59736 2023-07-11 21:49:54,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:54,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x304e1c85 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:49:54,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76ab8d83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:49:54,466 DEBUG [hconnection-0x733ef573-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:54,468 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:54,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:49:54,491 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:49:54,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x304e1c85 to 127.0.0.1:59736 2023-07-11 21:49:54,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:49:54,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:49:54,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:49:54,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:49:54,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:49:54,498 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:49:54,499 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689112794499 2023-07-11 21:49:54,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 21:49:54,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:49:54,501 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:49:54,501 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:49:54,503 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:49:54,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 21:49:54,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-11 21:49:54,510 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 21:49:54,511 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689112794511 2023-07-11 21:49:54,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,572 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-11 21:49:54,572 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:54,574 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 21:49:54,574 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 21:49:54,578 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,578 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,579 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:54,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,579 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:54,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:54,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,581 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,581 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,583 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,583 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:49:54,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 21:49:54,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 21:49:54,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 21:49:54,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 21:49:54,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,584 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 21:49:54,584 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 21:49:54,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,588 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 21:49:54,588 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:54,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,600 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 21:49:54,598 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 21:49:54,601 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 21:49:54,601 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 21:49:54,600 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:54,600 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 21:49:54,601 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:49:54,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 21:49:54,606 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:54,606 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 21:49:54,606 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 21:49:54,606 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 21:49:54,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 21:49:54,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 21:49:54,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:49:54,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:54,607 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:49:54,607 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,607 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:54,610 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,610 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,610 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,610 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:54,611 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,611 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:54,611 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,611 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,611 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:49:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:54,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 21:49:54,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b9b45da[Count = 1] remaining members to acquire global barrier 2023-07-11 21:49:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:54,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 21:49:54,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b9b45da[Count = 0] remaining members to acquire global barrier 2023-07-11 21:49:54,622 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 21:49:54,622 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,624 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:49:54,625 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 21:49:54,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:54,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:49:54,625 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:49:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:54,625 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:49:54,626 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:54,626 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:49:54,627 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 21:49:54,627 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:54,627 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 21:49:54,634 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:54,636 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:54,636 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:54,636 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:54,636 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:49:54,637 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. started... 2023-07-11 21:49:54,636 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. started... 2023-07-11 21:49:54,637 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3af291080617f6b9cf945a17084ff20a 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-11 21:49:54,637 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:49:54,637 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02d1275169db3eb6a43ce616bf7496db 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-11 21:49:54,704 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711a69262987434420bb40bb4a4dacc2614 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711a69262987434420bb40bb4a4dacc2614 2023-07-11 21:49:54,704 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711e9ea51e1ce9d403eab106091f1e87e38 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711e9ea51e1ce9d403eab106091f1e87e38 2023-07-11 21:49:54,807 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:54,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:49:54,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:54,811 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:49:55,111 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:55,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:49:55,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:55,113 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:49:55,121 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/.tmp/cf/c25ae3e47c80445c956b0501112bfddd 2023-07-11 21:49:55,123 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/.tmp/cf/b6cdde18ae6b4297a4219d03a15b94ba 2023-07-11 21:49:55,130 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/.tmp/cf/c25ae3e47c80445c956b0501112bfddd as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf/c25ae3e47c80445c956b0501112bfddd 2023-07-11 21:49:55,133 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/.tmp/cf/b6cdde18ae6b4297a4219d03a15b94ba as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf/b6cdde18ae6b4297a4219d03a15b94ba 2023-07-11 21:49:55,137 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf/c25ae3e47c80445c956b0501112bfddd, entries=44, sequenceid=6, filesize=12.6 K 2023-07-11 21:49:55,140 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf/b6cdde18ae6b4297a4219d03a15b94ba, entries=6, sequenceid=6, filesize=5.9 K 2023-07-11 21:49:55,143 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 02d1275169db3eb6a43ce616bf7496db in 506ms, sequenceid=6, compaction requested=false 2023-07-11 21:49:55,144 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-11 21:49:55,145 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02d1275169db3eb6a43ce616bf7496db: 2023-07-11 21:49:55,145 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,145 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:55,145 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf/c25ae3e47c80445c956b0501112bfddd] hfiles 2023-07-11 21:49:55,145 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf/c25ae3e47c80445c956b0501112bfddd for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,148 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 3af291080617f6b9cf945a17084ff20a in 509ms, sequenceid=6, compaction requested=false 2023-07-11 21:49:55,186 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3af291080617f6b9cf945a17084ff20a: 2023-07-11 21:49:55,186 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,186 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:49:55,186 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf/b6cdde18ae6b4297a4219d03a15b94ba] hfiles 2023-07-11 21:49:55,186 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf/b6cdde18ae6b4297a4219d03a15b94ba for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,278 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. completed. 2023-07-11 21:49:55,278 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:49:55,278 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:55,278 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:55,278 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,278 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 21:49:55,278 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:49:55,280 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 21:49:55,280 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,280 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:55,280 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 21:49:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:49:55,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 21:49:55,326 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. completed. 2023-07-11 21:49:55,326 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:49:55,326 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:49:55,326 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:49:55,326 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,326 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 21:49:55,326 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:49:55,329 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,329 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 21:49:55,329 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:55,329 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 21:49:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:49:55,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 21:49:55,346 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 21:49:55,346 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:49:55,346 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:49:55,346 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,346 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:49:55,348 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:55,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:55,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:55,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:49:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:49:55,348 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:55,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,349 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:49:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,350 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:49:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,350 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:49:55,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,353 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,353 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,355 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,358 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:55,359 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:55,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:55,359 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:55,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:55,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:55,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:55,359 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:55,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:55,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:55,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:55,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:55,363 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:49:55,363 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:49:55,363 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,363 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,364 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,364 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,364 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,364 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:49:55,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,364 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-11 21:49:55,364 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:49:55,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,364 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:49:55,376 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:49:55,376 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,376 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:49:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:49:55,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:49:55,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:49:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:49:55,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711e9ea51e1ce9d403eab106091f1e87e38, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711a69262987434420bb40bb4a4dacc2614] mob files 2023-07-11 21:49:55,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711e9ea51e1ce9d403eab106091f1e87e38 2023-07-11 21:49:55,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711a69262987434420bb40bb4a4dacc2614 2023-07-11 21:49:55,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,613 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:55,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:49:55,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:49:55,631 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 21:49:55,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0005_000001 (auth:SIMPLE) 2023-07-11 21:49:55,841 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 21:49:55,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,841 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:55,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689112194499Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689112195465 (+966 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689112195465Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689112195465Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689112195493 (+28 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689112195600 (+107 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689112195841 (+241 ms) 2023-07-11 21:49:55,845 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 21:49:55,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.3440 sec 2023-07-11 21:49:56,631 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:49:56,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:49:56,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:49:56,635 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635 2023-07-11 21:49:56,635 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:37147, tgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635, rawTgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635, srcFsUri=hdfs://localhost.localdomain:37147, srcDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:49:56,661 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:49:56,662 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1945084600_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:56,662 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e, snapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-11 21:49:56,681 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:49:56,863 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:56,864 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:56,864 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:56,865 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:56,980 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:49:58,021 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-2529024448817358090.jar 2023-07-11 21:49:58,022 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:58,023 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:58,107 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-5266561038917552797.jar 2023-07-11 21:49:58,108 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:58,108 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:58,109 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:58,109 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:58,110 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:58,110 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:49:58,111 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:49:58,112 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:49:58,112 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:49:58,113 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:49:58,113 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:49:58,114 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:49:58,114 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:49:58,115 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:49:58,115 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:49:58,116 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:49:58,117 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:49:58,117 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:49:58,118 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:49:58,118 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:49:58,119 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:49:58,119 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:49:58,120 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:50:00,119 WARN [Listener at jenkins-hbase17.apache.org/33347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:50:00,125 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-11 21:50:00,673 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:50:00,673 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:50:00,792 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0006_000001 (auth:SIMPLE) 2023-07-11 21:50:11,250 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0006_000001 (auth:SIMPLE) 2023-07-11 21:50:13,827 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:50:13,828 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:50:13,832 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:50:13,832 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:50:13,833 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:50:13,833 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:50:13,833 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 21:50:13,833 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 21:50:13,833 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:50:13,834 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 21:50:13,834 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112196635/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 21:50:13,838 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-11 21:50:13,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-07-11 21:50:13,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 21:50:13,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 21:50:13,844 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112213844"}]},"ts":"1689112213844"} 2023-07-11 21:50:13,846 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 21:50:13,906 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-11 21:50:13,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3af291080617f6b9cf945a17084ff20a, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=02d1275169db3eb6a43ce616bf7496db, UNASSIGN}] 2023-07-11 21:50:13,908 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=02d1275169db3eb6a43ce616bf7496db, UNASSIGN 2023-07-11 21:50:13,913 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3af291080617f6b9cf945a17084ff20a, UNASSIGN 2023-07-11 21:50:13,914 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=02d1275169db3eb6a43ce616bf7496db, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:13,914 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3af291080617f6b9cf945a17084ff20a, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:13,914 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112213913"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112213913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112213913"}]},"ts":"1689112213913"} 2023-07-11 21:50:13,914 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112213914"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112213914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112213914"}]},"ts":"1689112213914"} 2023-07-11 21:50:13,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 02d1275169db3eb6a43ce616bf7496db, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:50:13,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 3af291080617f6b9cf945a17084ff20a, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:50:13,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 21:50:14,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:50:14,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 02d1275169db3eb6a43ce616bf7496db, disabling compactions & flushes 2023-07-11 21:50:14,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:50:14,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:50:14,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. after waiting 0 ms 2023-07-11 21:50:14,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:50:14,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 3af291080617f6b9cf945a17084ff20a 2023-07-11 21:50:14,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 3af291080617f6b9cf945a17084ff20a, disabling compactions & flushes 2023-07-11 21:50:14,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:50:14,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:50:14,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. after waiting 0 ms 2023-07-11 21:50:14,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:50:14,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:50:14,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:50:14,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:50:14,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:50:14,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db. 2023-07-11 21:50:14,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a. 2023-07-11 21:50:14,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 02d1275169db3eb6a43ce616bf7496db: 2023-07-11 21:50:14,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 3af291080617f6b9cf945a17084ff20a: 2023-07-11 21:50:14,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:50:14,098 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=02d1275169db3eb6a43ce616bf7496db, regionState=CLOSED 2023-07-11 21:50:14,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 3af291080617f6b9cf945a17084ff20a 2023-07-11 21:50:14,098 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112214098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112214098"}]},"ts":"1689112214098"} 2023-07-11 21:50:14,098 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3af291080617f6b9cf945a17084ff20a, regionState=CLOSED 2023-07-11 21:50:14,099 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112214098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112214098"}]},"ts":"1689112214098"} 2023-07-11 21:50:14,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-11 21:50:14,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 02d1275169db3eb6a43ce616bf7496db, server=jenkins-hbase17.apache.org,35055,1689112018269 in 185 msec 2023-07-11 21:50:14,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-11 21:50:14,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 3af291080617f6b9cf945a17084ff20a, server=jenkins-hbase17.apache.org,34193,1689112018101 in 183 msec 2023-07-11 21:50:14,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=02d1275169db3eb6a43ce616bf7496db, UNASSIGN in 198 msec 2023-07-11 21:50:14,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-11 21:50:14,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3af291080617f6b9cf945a17084ff20a, UNASSIGN in 199 msec 2023-07-11 21:50:14,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112214107"}]},"ts":"1689112214107"} 2023-07-11 21:50:14,108 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 21:50:14,109 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-11 21:50:14,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 271 msec 2023-07-11 21:50:14,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 21:50:14,146 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-11 21:50:14,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,150 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,151 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,153 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,155 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,156 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,156 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 21:50:14,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 21:50:14,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 21:50:14,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 21:50:14,157 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,157 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,157 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:14,157 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:14,158 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,158 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,158 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:14,158 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:14,158 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:50:14,158 DEBUG [HFileArchiver-26] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a 2023-07-11 21:50:14,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 21:50:14,161 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/recovered.edits] 2023-07-11 21:50:14,162 DEBUG [HFileArchiver-26] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/recovered.edits] 2023-07-11 21:50:14,169 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf/c25ae3e47c80445c956b0501112bfddd to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/cf/c25ae3e47c80445c956b0501112bfddd 2023-07-11 21:50:14,169 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf/b6cdde18ae6b4297a4219d03a15b94ba to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/cf/b6cdde18ae6b4297a4219d03a15b94ba 2023-07-11 21:50:14,173 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db/recovered.edits/9.seqid 2023-07-11 21:50:14,174 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a/recovered.edits/9.seqid 2023-07-11 21:50:14,177 DEBUG [HFileArchiver-26] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/3af291080617f6b9cf945a17084ff20a 2023-07-11 21:50:14,177 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testEmptyExportFileSystemState/02d1275169db3eb6a43ce616bf7496db 2023-07-11 21:50:14,178 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 21:50:14,179 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-11 21:50:14,180 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-11 21:50:14,192 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711e9ea51e1ce9d403eab106091f1e87e38 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711e9ea51e1ce9d403eab106091f1e87e38 2023-07-11 21:50:14,194 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711a69262987434420bb40bb4a4dacc2614 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711a69262987434420bb40bb4a4dacc2614 2023-07-11 21:50:14,195 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-11 21:50:14,198 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,207 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-11 21:50:14,212 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-11 21:50:14,213 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,213 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-11 21:50:14,213 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112214213"}]},"ts":"9223372036854775807"} 2023-07-11 21:50:14,214 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112214213"}]},"ts":"9223372036854775807"} 2023-07-11 21:50:14,216 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 21:50:14,216 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3af291080617f6b9cf945a17084ff20a, NAME => 'testtb-testEmptyExportFileSystemState,,1689112192845.3af291080617f6b9cf945a17084ff20a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 02d1275169db3eb6a43ce616bf7496db, NAME => 'testtb-testEmptyExportFileSystemState,1,1689112192845.02d1275169db3eb6a43ce616bf7496db.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 21:50:14,216 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-11 21:50:14,216 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112214216"}]},"ts":"9223372036854775807"} 2023-07-11 21:50:14,228 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-11 21:50:14,230 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 21:50:14,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 83 msec 2023-07-11 21:50:14,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 21:50:14,262 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-11 21:50:14,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-11 21:50:14,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 21:50:14,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-11 21:50:14,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-11 21:50:14,310 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 756) Potentially hanging thread: HFileArchiver-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:50822 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to jenkins-hbase17.apache.org/136.243.18.41:37865 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:56102 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4936 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MoveIntermediateToDone Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MoveIntermediateToDone Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1663362976_1 at /127.0.0.1:50816 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1663362976_1 at /127.0.0.1:56088 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:46118 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MoveIntermediateToDone Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1468 (was 1522), ProcessCount=196 (was 190) - ProcessCount LEAK? -, AvailableMemoryMB=1195 (was 1166) - AvailableMemoryMB LEAK? - 2023-07-11 21:50:14,310 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-11 21:50:14,336 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=1468, ProcessCount=196, AvailableMemoryMB=1194 2023-07-11 21:50:14,337 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-11 21:50:14,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 21:50:14,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:14,349 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:50:14,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-11 21:50:14,350 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:50:14,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 21:50:14,352 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,352 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,354 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272 empty. 2023-07-11 21:50:14,354 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d empty. 2023-07-11 21:50:14,354 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,354 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,354 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 21:50:14,378 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-11 21:50:14,379 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => b992ef6407f50e7121c7619a2a29f67d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:50:14,379 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e100dc45e5f9d61af184c63baa1f272, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp 2023-07-11 21:50:14,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:50:14,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 5e100dc45e5f9d61af184c63baa1f272, disabling compactions & flushes 2023-07-11 21:50:14,415 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:14,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:14,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. after waiting 0 ms 2023-07-11 21:50:14,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:14,415 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:14,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 5e100dc45e5f9d61af184c63baa1f272: 2023-07-11 21:50:14,435 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:50:14,435 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing b992ef6407f50e7121c7619a2a29f67d, disabling compactions & flushes 2023-07-11 21:50:14,435 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:14,435 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:14,435 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. after waiting 0 ms 2023-07-11 21:50:14,435 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:14,435 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:14,436 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for b992ef6407f50e7121c7619a2a29f67d: 2023-07-11 21:50:14,440 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:50:14,441 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112214440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112214440"}]},"ts":"1689112214440"} 2023-07-11 21:50:14,441 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112214440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112214440"}]},"ts":"1689112214440"} 2023-07-11 21:50:14,443 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:50:14,444 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:50:14,444 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112214444"}]},"ts":"1689112214444"} 2023-07-11 21:50:14,446 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-11 21:50:14,448 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:50:14,449 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:50:14,449 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:50:14,449 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:50:14,449 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:50:14,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5e100dc45e5f9d61af184c63baa1f272, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b992ef6407f50e7121c7619a2a29f67d, ASSIGN}] 2023-07-11 21:50:14,453 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5e100dc45e5f9d61af184c63baa1f272, ASSIGN 2023-07-11 21:50:14,453 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b992ef6407f50e7121c7619a2a29f67d, ASSIGN 2023-07-11 21:50:14,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 21:50:14,455 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5e100dc45e5f9d61af184c63baa1f272, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34193,1689112018101; forceNewPlan=false, retain=false 2023-07-11 21:50:14,455 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b992ef6407f50e7121c7619a2a29f67d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35055,1689112018269; forceNewPlan=false, retain=false 2023-07-11 21:50:14,606 INFO [jenkins-hbase17:44551] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:50:14,609 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b992ef6407f50e7121c7619a2a29f67d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:14,610 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112214609"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112214609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112214609"}]},"ts":"1689112214609"} 2023-07-11 21:50:14,609 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5e100dc45e5f9d61af184c63baa1f272, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:14,611 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112214609"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112214609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112214609"}]},"ts":"1689112214609"} 2023-07-11 21:50:14,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure b992ef6407f50e7121c7619a2a29f67d, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:50:14,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 5e100dc45e5f9d61af184c63baa1f272, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:50:14,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 21:50:14,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:14,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b992ef6407f50e7121c7619a2a29f67d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:50:14,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. service=AccessControlService 2023-07-11 21:50:14,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:50:14,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:50:14,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,772 INFO [StoreOpener-b992ef6407f50e7121c7619a2a29f67d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e100dc45e5f9d61af184c63baa1f272, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:50:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. service=AccessControlService 2023-07-11 21:50:14,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:50:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:50:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,777 DEBUG [StoreOpener-b992ef6407f50e7121c7619a2a29f67d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf 2023-07-11 21:50:14,777 DEBUG [StoreOpener-b992ef6407f50e7121c7619a2a29f67d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf 2023-07-11 21:50:14,778 INFO [StoreOpener-b992ef6407f50e7121c7619a2a29f67d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b992ef6407f50e7121c7619a2a29f67d columnFamilyName cf 2023-07-11 21:50:14,779 INFO [StoreOpener-5e100dc45e5f9d61af184c63baa1f272-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,782 INFO [StoreOpener-b992ef6407f50e7121c7619a2a29f67d-1] regionserver.HStore(310): Store=b992ef6407f50e7121c7619a2a29f67d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:50:14,783 DEBUG [StoreOpener-5e100dc45e5f9d61af184c63baa1f272-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf 2023-07-11 21:50:14,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:14,791 DEBUG [StoreOpener-5e100dc45e5f9d61af184c63baa1f272-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf 2023-07-11 21:50:14,792 INFO [StoreOpener-5e100dc45e5f9d61af184c63baa1f272-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e100dc45e5f9d61af184c63baa1f272 columnFamilyName cf 2023-07-11 21:50:14,793 INFO [StoreOpener-5e100dc45e5f9d61af184c63baa1f272-1] regionserver.HStore(310): Store=5e100dc45e5f9d61af184c63baa1f272/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:50:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:50:14,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:14,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b992ef6407f50e7121c7619a2a29f67d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70998517, jitterRate=0.05796034634113312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:50:14,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b992ef6407f50e7121c7619a2a29f67d: 2023-07-11 21:50:14,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d., pid=108, masterSystemTime=1689112214766 2023-07-11 21:50:14,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:50:14,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:14,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:14,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 5e100dc45e5f9d61af184c63baa1f272; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69493546, jitterRate=0.03553453087806702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:50:14,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 5e100dc45e5f9d61af184c63baa1f272: 2023-07-11 21:50:14,806 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b992ef6407f50e7121c7619a2a29f67d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:14,806 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112214805"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112214805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112214805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112214805"}]},"ts":"1689112214805"} 2023-07-11 21:50:14,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272., pid=109, masterSystemTime=1689112214771 2023-07-11 21:50:14,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:14,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:14,816 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5e100dc45e5f9d61af184c63baa1f272, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:14,817 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112214816"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689112214816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112214816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112214816"}]},"ts":"1689112214816"} 2023-07-11 21:50:14,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-11 21:50:14,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure b992ef6407f50e7121c7619a2a29f67d, server=jenkins-hbase17.apache.org,35055,1689112018269 in 197 msec 2023-07-11 21:50:14,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b992ef6407f50e7121c7619a2a29f67d, ASSIGN in 370 msec 2023-07-11 21:50:14,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-11 21:50:14,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 5e100dc45e5f9d61af184c63baa1f272, server=jenkins-hbase17.apache.org,34193,1689112018101 in 207 msec 2023-07-11 21:50:14,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-11 21:50:14,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5e100dc45e5f9d61af184c63baa1f272, ASSIGN in 373 msec 2023-07-11 21:50:14,832 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:50:14,832 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112214832"}]},"ts":"1689112214832"} 2023-07-11 21:50:14,837 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-11 21:50:14,840 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:50:14,840 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-11 21:50:14,843 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 21:50:14,844 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:14,844 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:14,844 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:14,845 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:14,845 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 21:50:14,846 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 21:50:14,846 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 21:50:14,848 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:14,849 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 21:50:14,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 503 msec 2023-07-11 21:50:14,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 21:50:14,957 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-11 21:50:14,959 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:14,959 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:14,961 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:50:15,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 21:50:15,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112215020 (current time:1689112215020). 2023-07-11 21:50:15,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:50:15,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x3d9c88a4 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:50:15,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70502449, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:50:15,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:50:15,059 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:50:15,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d9c88a4 to 127.0.0.1:59736 2023-07-11 21:50:15,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:50:15,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x3b8c2a19 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:50:15,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@620c4c64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:50:15,094 DEBUG [hconnection-0x138f4e00-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:50:15,099 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:50:15,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:50:15,116 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:50:15,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b8c2a19 to 127.0.0.1:59736 2023-07-11 21:50:15,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:50:15,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 21:50:15,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:50:15,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 21:50:15,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 21:50:15,124 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 21:50:15,125 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689112815125 2023-07-11 21:50:15,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 21:50:15,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,127 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:50:15,127 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:50:15,130 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 21:50:15,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 21:50:15,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-11 21:50:15,134 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 21:50:15,137 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689112815137 2023-07-11 21:50:15,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,161 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 21:50:15,161 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:50:15,163 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 21:50:15,163 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 21:50:15,164 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,164 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,170 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,171 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,171 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,172 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,172 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,172 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 21:50:15,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,173 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,173 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:50:15,173 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 21:50:15,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,174 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 21:50:15,174 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:50:15,176 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 21:50:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,176 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 21:50:15,176 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 21:50:15,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 21:50:15,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,177 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 21:50:15,178 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,178 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,178 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:50:15,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,180 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 21:50:15,180 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:50:15,182 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 21:50:15,183 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 21:50:15,183 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 21:50:15,186 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 21:50:15,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:15,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:15,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 21:50:15,187 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,188 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 21:50:15,188 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:50:15,191 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 21:50:15,191 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 21:50:15,191 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 21:50:15,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:15,191 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,192 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:50:15,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:15,194 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,194 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,194 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,194 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:50:15,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:15,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 21:50:15,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d6341d[Count = 1] remaining members to acquire global barrier 2023-07-11 21:50:15,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:15,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:15,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:15,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:15,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:15,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 21:50:15,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d6341d[Count = 0] remaining members to acquire global barrier 2023-07-11 21:50:15,198 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 21:50:15,198 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,198 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,198 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,198 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,199 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 21:50:15,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:50:15,199 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,199 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 21:50:15,199 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:15,199 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:15,199 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. started... 2023-07-11 21:50:15,199 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:50:15,199 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. started... 2023-07-11 21:50:15,199 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e100dc45e5f9d61af184c63baa1f272: 2023-07-11 21:50:15,201 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b992ef6407f50e7121c7619a2a29f67d: 2023-07-11 21:50:15,201 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,201 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:50:15,201 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:50:15,201 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,201 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:50:15,201 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:50:15,202 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 21:50:15,202 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:50:15,202 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 21:50:15,216 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. completed. 2023-07-11 21:50:15,216 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:15,216 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:50:15,216 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:50:15,216 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,217 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 21:50:15,217 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:50:15,218 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 21:50:15,218 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,218 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:50:15,218 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 21:50:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:50:15,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 21:50:15,228 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:50:15,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 21:50:15,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:50:15,229 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:50:15,238 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. completed. 2023-07-11 21:50:15,239 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:15,239 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:50:15,239 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:50:15,239 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,239 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 21:50:15,239 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:50:15,240 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,240 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 21:50:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:15,240 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:50:15,241 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 21:50:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:50:15,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 21:50:15,247 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 21:50:15,248 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:50:15,248 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:50:15,248 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,248 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:50:15,250 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:15,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:15,250 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:15,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:15,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:15,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:15,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:15,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:15,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,251 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:15,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,252 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,252 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:15,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:15,254 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,254 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,255 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,258 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,258 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,258 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:15,258 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,258 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:15,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,258 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:15,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,258 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:50:15,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,260 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,260 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:15,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:15,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:15,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:15,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:15,260 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:15,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,260 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:50:15,264 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,264 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,264 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,264 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,264 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,264 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,264 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 21:50:15,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 21:50:15,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,333 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689112215126Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689112215278 (+152 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689112215278Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689112215279 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689112215283 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689112215297 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689112215333 (+36 ms) 2023-07-11 21:50:15,336 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 21:50:15,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 209 msec 2023-07-11 21:50:15,429 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:50:15,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 21:50:15,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:50:15,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34193] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:50:15,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35055] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:50:15,439 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,439 DEBUG [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:15,440 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:50:15,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 21:50:15,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112215452 (current time:1689112215452). 2023-07-11 21:50:15,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:50:15,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x2771f1be to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:50:15,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ee7541e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:50:15,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:50:15,469 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:50:15,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2771f1be to 127.0.0.1:59736 2023-07-11 21:50:15,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:50:15,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(139): Connect 0x25003e54 to 127.0.0.1:59736 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:50:15,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dd4c74b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:50:15,479 DEBUG [hconnection-0x7967254b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:50:15,483 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:50:15,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:50:15,491 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:50:15,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25003e54 to 127.0.0.1:59736 2023-07-11 21:50:15,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:50:15,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 21:50:15,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:50:15,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 21:50:15,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 21:50:15,498 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 21:50:15,506 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689112815506 2023-07-11 21:50:15,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 21:50:15,508 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:50:15,508 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:50:15,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 21:50:15,512 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 21:50:15,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 16 msec 2023-07-11 21:50:15,518 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 21:50:15,518 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689112815518 2023-07-11 21:50:15,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,540 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 21:50:15,540 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:50:15,542 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 21:50:15,542 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 21:50:15,597 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,597 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,598 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,598 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,598 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,598 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:15,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,598 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:15,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:15,598 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,600 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,600 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:50:15,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 21:50:15,601 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,601 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:50:15,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,603 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 21:50:15,603 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 21:50:15,603 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 21:50:15,603 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 21:50:15,603 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:50:15,603 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 21:50:15,603 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,604 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 21:50:15,604 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 21:50:15,605 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:50:15,604 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 21:50:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 21:50:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46731,1689112018018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 21:50:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 21:50:15,606 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 21:50:15,607 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,607 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:15,607 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,607 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,608 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:50:15,609 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:15,609 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,609 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:50:15,609 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,609 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:50:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:15,609 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,609 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:50:15,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 21:50:15,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:50:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,610 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:50:15,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:15,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34193,1689112018101' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 21:50:15,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b59f7fd[Count = 1] remaining members to acquire global barrier 2023-07-11 21:50:15,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:15,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35055,1689112018269' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 21:50:15,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b59f7fd[Count = 0] remaining members to acquire global barrier 2023-07-11 21:50:15,614 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 21:50:15,614 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,614 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,614 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,614 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 21:50:15,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,615 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:50:15,615 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:50:15,615 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:15,615 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,615 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:50:15,615 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. started... 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:50:15,615 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. started... 2023-07-11 21:50:15,615 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,46731,1689112018018' in zk 2023-07-11 21:50:15,615 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b992ef6407f50e7121c7619a2a29f67d 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-11 21:50:15,615 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5e100dc45e5f9d61af184c63baa1f272 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-11 21:50:15,617 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 21:50:15,617 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:50:15,617 DEBUG [member: 'jenkins-hbase17.apache.org,46731,1689112018018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 21:50:15,645 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071120d6251ded8a4377b1dd9eabb6421a76 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071120d6251ded8a4377b1dd9eabb6421a76 2023-07-11 21:50:15,645 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711b03c9e640300428ea139aa1bf35556f2 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711b03c9e640300428ea139aa1bf35556f2 2023-07-11 21:50:15,673 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/.tmp/cf/174c6a036d784edda692999873364120 2023-07-11 21:50:15,680 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/.tmp/cf/174c6a036d784edda692999873364120 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf/174c6a036d784edda692999873364120 2023-07-11 21:50:15,685 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf/174c6a036d784edda692999873364120, entries=49, sequenceid=6, filesize=13.7 K 2023-07-11 21:50:15,687 INFO [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for b992ef6407f50e7121c7619a2a29f67d in 72ms, sequenceid=6, compaction requested=false 2023-07-11 21:50:15,687 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-11 21:50:15,688 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b992ef6407f50e7121c7619a2a29f67d: 2023-07-11 21:50:15,688 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,688 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:50:15,688 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf/174c6a036d784edda692999873364120] hfiles 2023-07-11 21:50:15,688 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf/174c6a036d784edda692999873364120 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,794 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. completed. 2023-07-11 21:50:15,794 DEBUG [rs(jenkins-hbase17.apache.org,35055,1689112018269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:15,794 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:50:15,794 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:50:15,794 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,794 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 21:50:15,794 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35055,1689112018269' in zk 2023-07-11 21:50:15,800 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,800 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 21:50:15,800 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:50:15,800 DEBUG [member: 'jenkins-hbase17.apache.org,35055,1689112018269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 21:50:15,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:15,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:15,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:15,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:15,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,35055,1689112018269': 2023-07-11 21:50:15,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35055,1689112018269' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 21:50:15,810 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:50:15,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 21:50:15,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:50:15,812 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:50:16,073 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/.tmp/cf/4120974ad65d4efebd86c3a1887377ff 2023-07-11 21:50:16,084 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/.tmp/cf/4120974ad65d4efebd86c3a1887377ff as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf/4120974ad65d4efebd86c3a1887377ff 2023-07-11 21:50:16,093 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf/4120974ad65d4efebd86c3a1887377ff, entries=1, sequenceid=6, filesize=5.1 K 2023-07-11 21:50:16,094 INFO [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 5e100dc45e5f9d61af184c63baa1f272 in 479ms, sequenceid=6, compaction requested=false 2023-07-11 21:50:16,096 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e100dc45e5f9d61af184c63baa1f272: 2023-07-11 21:50:16,096 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,096 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:50:16,096 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf/4120974ad65d4efebd86c3a1887377ff] hfiles 2023-07-11 21:50:16,096 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf/4120974ad65d4efebd86c3a1887377ff for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,111 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. completed. 2023-07-11 21:50:16,111 DEBUG [rs(jenkins-hbase17.apache.org,34193,1689112018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:16,112 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:50:16,112 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:50:16,112 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,112 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 21:50:16,112 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,34193,1689112018101' in zk 2023-07-11 21:50:16,112 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:50:16,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 21:50:16,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:50:16,113 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:50:16,113 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 21:50:16,113 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,113 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:50:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,113 DEBUG [member: 'jenkins-hbase17.apache.org,34193,1689112018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 21:50:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:16,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:16,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:16,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:16,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,34193,1689112018101': 2023-07-11 21:50:16,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34193,1689112018101' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 21:50:16,119 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 21:50:16,119 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:50:16,119 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:50:16,119 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,120 INFO [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:50:16,120 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,120 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:50:16,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:16,121 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:16,120 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:50:16,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:16,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:16,122 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:50:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,122 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:16,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,123 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:16,124 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:50:16,124 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:16,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:16,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:16,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:16,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:16,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:16,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:16,126 DEBUG [(jenkins-hbase17.apache.org,44551,1689112016009)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:50:16,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:50:16,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,126 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:50:16,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:50:16,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:50:16,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:16,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:16,128 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,129 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:16,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:50:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:50:16,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 21:50:16,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711b03c9e640300428ea139aa1bf35556f2, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071120d6251ded8a4377b1dd9eabb6421a76] mob files 2023-07-11 21:50:16,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711b03c9e640300428ea139aa1bf35556f2 2023-07-11 21:50:16,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071120d6251ded8a4377b1dd9eabb6421a76 2023-07-11 21:50:16,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 21:50:16,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,206 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689112215506Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689112216153 (+647 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689112216153Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689112216153Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689112216161 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689112216176 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689112216206 (+30 ms) 2023-07-11 21:50:16,208 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 21:50:16,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 701 msec 2023-07-11 21:50:16,613 DEBUG [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:50:16,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 21:50:16,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:50:16,614 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614 2023-07-11 21:50:16,614 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:37147, tgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614, rawTgtDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614, srcFsUri=hdfs://localhost.localdomain:37147, srcDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:50:16,648 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e 2023-07-11 21:50:16,649 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_528815671_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,649 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:37147, inputRoot=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e, snapshotDir=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-11 21:50:16,675 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:16,722 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:16,723 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:16,724 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:16,724 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,727 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-2864493916119745353.jar 2023-07-11 21:50:17,728 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,728 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,800 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/hadoop-4776464292535558026.jar 2023-07-11 21:50:17,801 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,801 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,801 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,802 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,802 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,802 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:50:17,803 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:50:17,803 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:50:17,803 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:50:17,804 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:50:17,804 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:50:17,804 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:50:17,805 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:50:17,805 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:50:17,805 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:50:17,806 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:50:17,806 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:50:17,807 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:50:17,807 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:50:17,807 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:50:17,807 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:50:17,808 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:50:17,808 DEBUG [Listener at jenkins-hbase17.apache.org/33347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:50:18,699 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0006_000001 (auth:SIMPLE) 2023-07-11 21:50:18,837 WARN [Listener at jenkins-hbase17.apache.org/33347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:50:18,840 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-11 21:50:18,843 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-11 21:50:19,072 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:50:19,074 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:50:19,618 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0007_000001 (auth:SIMPLE) 2023-07-11 21:50:19,739 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:50:27,076 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0007_000001 (auth:SIMPLE) 2023-07-11 21:50:29,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0007_000001 (auth:SIMPLE) 2023-07-11 21:50:37,111 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112033037_0007_000001 (auth:SIMPLE) 2023-07-11 21:50:38,673 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:50:38,673 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:50:38,752 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:38,752 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:50:38,753 INFO [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:50:38,753 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:38,753 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 21:50:38,754 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 21:50:38,754 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_503064725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:38,754 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 21:50:38,754 DEBUG [Listener at jenkins-hbase17.apache.org/33347] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/export-test/export-1689112216614/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 21:50:38,768 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:38,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:38,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:38,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 21:50:38,774 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112238774"}]},"ts":"1689112238774"} 2023-07-11 21:50:38,776 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-11 21:50:38,777 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-11 21:50:38,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5e100dc45e5f9d61af184c63baa1f272, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b992ef6407f50e7121c7619a2a29f67d, UNASSIGN}] 2023-07-11 21:50:38,792 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5e100dc45e5f9d61af184c63baa1f272, UNASSIGN 2023-07-11 21:50:38,792 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b992ef6407f50e7121c7619a2a29f67d, UNASSIGN 2023-07-11 21:50:38,794 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b992ef6407f50e7121c7619a2a29f67d, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:50:38,794 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5e100dc45e5f9d61af184c63baa1f272, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:50:38,794 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112238794"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112238794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112238794"}]},"ts":"1689112238794"} 2023-07-11 21:50:38,794 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112238794"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689112238794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112238794"}]},"ts":"1689112238794"} 2023-07-11 21:50:38,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 5e100dc45e5f9d61af184c63baa1f272, server=jenkins-hbase17.apache.org,34193,1689112018101}] 2023-07-11 21:50:38,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure b992ef6407f50e7121c7619a2a29f67d, server=jenkins-hbase17.apache.org,35055,1689112018269}] 2023-07-11 21:50:38,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 21:50:38,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:38,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 5e100dc45e5f9d61af184c63baa1f272, disabling compactions & flushes 2023-07-11 21:50:38,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:38,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:38,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. after waiting 0 ms 2023-07-11 21:50:38,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:38,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:38,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b992ef6407f50e7121c7619a2a29f67d, disabling compactions & flushes 2023-07-11 21:50:38,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:38,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:38,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. after waiting 0 ms 2023-07-11 21:50:38,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:38,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:50:38,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:50:39,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272. 2023-07-11 21:50:39,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 5e100dc45e5f9d61af184c63baa1f272: 2023-07-11 21:50:39,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:50:39,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:50:39,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d. 2023-07-11 21:50:39,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b992ef6407f50e7121c7619a2a29f67d: 2023-07-11 21:50:39,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:39,022 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5e100dc45e5f9d61af184c63baa1f272, regionState=CLOSED 2023-07-11 21:50:39,022 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112239022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112239022"}]},"ts":"1689112239022"} 2023-07-11 21:50:39,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:39,026 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b992ef6407f50e7121c7619a2a29f67d, regionState=CLOSED 2023-07-11 21:50:39,026 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112239026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112239026"}]},"ts":"1689112239026"} 2023-07-11 21:50:39,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-11 21:50:39,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 5e100dc45e5f9d61af184c63baa1f272, server=jenkins-hbase17.apache.org,34193,1689112018101 in 227 msec 2023-07-11 21:50:39,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-11 21:50:39,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5e100dc45e5f9d61af184c63baa1f272, UNASSIGN in 246 msec 2023-07-11 21:50:39,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure b992ef6407f50e7121c7619a2a29f67d, server=jenkins-hbase17.apache.org,35055,1689112018269 in 231 msec 2023-07-11 21:50:39,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-11 21:50:39,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b992ef6407f50e7121c7619a2a29f67d, UNASSIGN in 248 msec 2023-07-11 21:50:39,042 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112239042"}]},"ts":"1689112239042"} 2023-07-11 21:50:39,044 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-11 21:50:39,045 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-11 21:50:39,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 278 msec 2023-07-11 21:50:39,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 21:50:39,078 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-11 21:50:39,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,083 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,085 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,088 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35055] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,091 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,091 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,091 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,091 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 21:50:39,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 21:50:39,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 21:50:39,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 21:50:39,098 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,098 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:39,098 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,098 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:39,098 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,098 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:39,099 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,099 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:50:39,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 21:50:39,105 DEBUG [HFileArchiver-27] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:39,112 DEBUG [HFileArchiver-28] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:39,116 DEBUG [HFileArchiver-27] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/recovered.edits] 2023-07-11 21:50:39,122 DEBUG [HFileArchiver-28] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf, FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/recovered.edits] 2023-07-11 21:50:39,124 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf/4120974ad65d4efebd86c3a1887377ff to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/cf/4120974ad65d4efebd86c3a1887377ff 2023-07-11 21:50:39,131 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272/recovered.edits/9.seqid 2023-07-11 21:50:39,132 DEBUG [HFileArchiver-27] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5e100dc45e5f9d61af184c63baa1f272 2023-07-11 21:50:39,133 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf/174c6a036d784edda692999873364120 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/cf/174c6a036d784edda692999873364120 2023-07-11 21:50:39,142 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/recovered.edits/9.seqid to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d/recovered.edits/9.seqid 2023-07-11 21:50:39,150 DEBUG [HFileArchiver-28] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b992ef6407f50e7121c7619a2a29f67d 2023-07-11 21:50:39,150 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 21:50:39,151 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-11 21:50:39,155 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-11 21:50:39,165 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711b03c9e640300428ea139aa1bf35556f2 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711b03c9e640300428ea139aa1bf35556f2 2023-07-11 21:50:39,166 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071120d6251ded8a4377b1dd9eabb6421a76 to hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071120d6251ded8a4377b1dd9eabb6421a76 2023-07-11 21:50:39,167 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-11 21:50:39,176 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,179 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-11 21:50:39,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 21:50:39,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-11 21:50:39,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-11 21:50:39,205 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112239205"}]},"ts":"9223372036854775807"} 2023-07-11 21:50:39,205 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112239205"}]},"ts":"9223372036854775807"} 2023-07-11 21:50:39,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 21:50:39,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5e100dc45e5f9d61af184c63baa1f272, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689112214339.5e100dc45e5f9d61af184c63baa1f272.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b992ef6407f50e7121c7619a2a29f67d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112214339.b992ef6407f50e7121c7619a2a29f67d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 21:50:39,212 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-11 21:50:39,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112239212"}]},"ts":"9223372036854775807"} 2023-07-11 21:50:39,226 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-11 21:50:39,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 149 msec 2023-07-11 21:50:39,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 21:50:39,402 INFO [Listener at jenkins-hbase17.apache.org/33347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-11 21:50:39,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 21:50:39,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 21:50:39,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44551] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 21:50:39,466 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 764) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:44464 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:56852 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-52 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (335529559) connection to jenkins-hbase17.apache.org/136.243.18.41:36487 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-130141213_1 at /127.0.0.1:57214 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-130141213_1 at /127.0.0.1:52620 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5580 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-51 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_503064725_17 at /127.0.0.1:51420 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-50 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4dbc74e2-shared-pool-49 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=900 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1465 (was 1468), ProcessCount=190 (was 196), AvailableMemoryMB=2732 (was 1194) - AvailableMemoryMB LEAK? - 2023-07-11 21:50:39,466 WARN [Listener at jenkins-hbase17.apache.org/33347] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-11 21:50:39,466 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-11 21:50:39,497 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-11 21:50:39,634 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689112033037_0007_01_000001 is : 143 2023-07-11 21:50:44,621 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:50:53,656 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-11 21:50:53,659 WARN [1304871146@qtp-1146861890-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:39421] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-11 21:50:53,659 WARN [1304871146@qtp-1146861890-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:39421] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-11 21:51:07,754 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 21:51:07,755 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-11 21:51:07,885 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-11 21:51:07,891 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-11 21:51:07,892 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 21:51:07,933 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-11 21:51:08,040 ERROR [Thread[Thread-386,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 21:51:08,040 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-11 21:51:08,040 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 21:51:08,040 INFO [Listener at jenkins-hbase17.apache.org/33347] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 21:51:08,041 DEBUG [Listener at jenkins-hbase17.apache.org/33347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33fbac76 to 127.0.0.1:59736 2023-07-11 21:51:08,041 DEBUG [Listener at jenkins-hbase17.apache.org/33347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,041 DEBUG [Listener at jenkins-hbase17.apache.org/33347] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 21:51:08,041 DEBUG [Listener at jenkins-hbase17.apache.org/33347] util.JVMClusterUtil(257): Found active master hash=1552486015, stopped=false 2023-07-11 21:51:08,041 DEBUG [Listener at jenkins-hbase17.apache.org/33347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:51:08,041 DEBUG [Listener at jenkins-hbase17.apache.org/33347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 21:51:08,041 INFO [Listener at jenkins-hbase17.apache.org/33347] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:51:08,044 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:51:08,044 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:51:08,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:51:08,044 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:51:08,044 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:51:08,045 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:51:08,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:51:08,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:51:08,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:51:08,047 INFO [Listener at jenkins-hbase17.apache.org/33347] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 21:51:08,047 DEBUG [Listener at jenkins-hbase17.apache.org/33347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31d2f99c to 127.0.0.1:59736 2023-07-11 21:51:08,047 DEBUG [Listener at jenkins-hbase17.apache.org/33347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,047 INFO [Listener at jenkins-hbase17.apache.org/33347] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,46731,1689112018018' ***** 2023-07-11 21:51:08,048 DEBUG [Listener at jenkins-hbase17.apache.org/33347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:51:08,049 INFO [Listener at jenkins-hbase17.apache.org/33347] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 21:51:08,049 INFO [Listener at jenkins-hbase17.apache.org/33347] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,34193,1689112018101' ***** 2023-07-11 21:51:08,049 DEBUG [Listener at jenkins-hbase17.apache.org/33347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:51:08,049 INFO [Listener at jenkins-hbase17.apache.org/33347] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 21:51:08,049 INFO [Listener at jenkins-hbase17.apache.org/33347] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35055,1689112018269' ***** 2023-07-11 21:51:08,049 DEBUG [Listener at jenkins-hbase17.apache.org/33347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:51:08,049 INFO [Listener at jenkins-hbase17.apache.org/33347] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 21:51:08,050 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 21:51:08,050 INFO [RS:0;jenkins-hbase17:46731] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 21:51:08,050 INFO [RS:0;jenkins-hbase17:46731] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 21:51:08,050 INFO [RS:0;jenkins-hbase17:46731] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 21:51:08,050 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 21:51:08,050 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(3305): Received CLOSE for d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:51:08,050 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:51:08,050 DEBUG [RS:0;jenkins-hbase17:46731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64f2c721 to 127.0.0.1:59736 2023-07-11 21:51:08,051 DEBUG [RS:0;jenkins-hbase17:46731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing d4fd312289bd134fd11c0c7009c6b355, disabling compactions & flushes 2023-07-11 21:51:08,054 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 21:51:08,054 INFO [RS:2;jenkins-hbase17:35055] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 21:51:08,054 INFO [RS:2;jenkins-hbase17:35055] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 21:51:08,054 INFO [RS:2;jenkins-hbase17:35055] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 21:51:08,055 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(3305): Received CLOSE for b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:51:08,055 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:51:08,055 DEBUG [RS:2;jenkins-hbase17:35055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a959f41 to 127.0.0.1:59736 2023-07-11 21:51:08,055 DEBUG [RS:2;jenkins-hbase17:35055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,054 INFO [RS:1;jenkins-hbase17:34193] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 21:51:08,055 INFO [RS:1;jenkins-hbase17:34193] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 21:51:08,055 INFO [RS:1;jenkins-hbase17:34193] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 21:51:08,055 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:51:08,055 DEBUG [RS:1;jenkins-hbase17:34193] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ec33ceb to 127.0.0.1:59736 2023-07-11 21:51:08,055 DEBUG [RS:1;jenkins-hbase17:34193] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:51:08,058 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 21:51:08,058 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1478): Online Regions={b9a6bdc4bb71f39b337a61f8253a86fc=hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc.} 2023-07-11 21:51:08,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b9a6bdc4bb71f39b337a61f8253a86fc, disabling compactions & flushes 2023-07-11 21:51:08,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:51:08,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:51:08,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. after waiting 0 ms 2023-07-11 21:51:08,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:51:08,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing b9a6bdc4bb71f39b337a61f8253a86fc 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-11 21:51:08,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:51:08,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. after waiting 0 ms 2023-07-11 21:51:08,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:51:08,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing d4fd312289bd134fd11c0c7009c6b355 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 21:51:08,059 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1504): Waiting on b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:51:08,059 INFO [RS:1;jenkins-hbase17:34193] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 21:51:08,059 INFO [RS:1;jenkins-hbase17:34193] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 21:51:08,059 INFO [RS:1;jenkins-hbase17:34193] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 21:51:08,059 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 21:51:08,059 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 21:51:08,059 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1478): Online Regions={d4fd312289bd134fd11c0c7009c6b355=hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355.} 2023-07-11 21:51:08,060 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1504): Waiting on d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:51:08,060 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 21:51:08,061 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-11 21:51:08,061 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 21:51:08,071 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:51:08,071 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:51:08,071 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:51:08,071 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:51:08,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:51:08,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-07-11 21:51:08,086 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:51:08,106 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:51:08,118 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:51:08,259 DEBUG [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1504): Waiting on b9a6bdc4bb71f39b337a61f8253a86fc 2023-07-11 21:51:08,261 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1504): Waiting on d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:51:08,261 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 21:51:08,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355/.tmp/info/cebeea3e75064699af368975e8ef4de4 2023-07-11 21:51:08,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc/.tmp/l/edd2dedb203d4a6dbec08bb9c84b7fee 2023-07-11 21:51:08,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355/.tmp/info/cebeea3e75064699af368975e8ef4de4 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355/info/cebeea3e75064699af368975e8ef4de4 2023-07-11 21:51:08,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edd2dedb203d4a6dbec08bb9c84b7fee 2023-07-11 21:51:08,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc/.tmp/l/edd2dedb203d4a6dbec08bb9c84b7fee as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc/l/edd2dedb203d4a6dbec08bb9c84b7fee 2023-07-11 21:51:08,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355/info/cebeea3e75064699af368975e8ef4de4, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 21:51:08,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d4fd312289bd134fd11c0c7009c6b355 in 282ms, sequenceid=6, compaction requested=false 2023-07-11 21:51:08,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edd2dedb203d4a6dbec08bb9c84b7fee 2023-07-11 21:51:08,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc/l/edd2dedb203d4a6dbec08bb9c84b7fee, entries=7, sequenceid=18, filesize=5.2 K 2023-07-11 21:51:08,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for b9a6bdc4bb71f39b337a61f8253a86fc in 296ms, sequenceid=18, compaction requested=false 2023-07-11 21:51:08,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/.tmp/info/2cc95f6f1cc644d1964057e8f4f9eaa8 2023-07-11 21:51:08,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cc95f6f1cc644d1964057e8f4f9eaa8 2023-07-11 21:51:08,447 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 21:51:08,448 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 21:51:08,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/acl/b9a6bdc4bb71f39b337a61f8253a86fc/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-11 21:51:08,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:51:08,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:51:08,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b9a6bdc4bb71f39b337a61f8253a86fc: 2023-07-11 21:51:08,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689112024350.b9a6bdc4bb71f39b337a61f8253a86fc. 2023-07-11 21:51:08,459 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35055,1689112018269; all regions closed. 2023-07-11 21:51:08,461 DEBUG [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1504): Waiting on d4fd312289bd134fd11c0c7009c6b355 2023-07-11 21:51:08,461 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 21:51:08,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/namespace/d4fd312289bd134fd11c0c7009c6b355/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:51:08,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:51:08,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:51:08,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for d4fd312289bd134fd11c0c7009c6b355: 2023-07-11 21:51:08,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689112022917.d4fd312289bd134fd11c0c7009c6b355. 2023-07-11 21:51:08,501 DEBUG [RS:2;jenkins-hbase17:35055] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/oldWALs 2023-07-11 21:51:08,501 INFO [RS:2;jenkins-hbase17:35055] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35055%2C1689112018269:(num 1689112021826) 2023-07-11 21:51:08,501 DEBUG [RS:2;jenkins-hbase17:35055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,501 INFO [RS:2;jenkins-hbase17:35055] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:51:08,502 INFO [RS:2;jenkins-hbase17:35055] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 21:51:08,503 INFO [RS:2;jenkins-hbase17:35055] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 21:51:08,503 INFO [RS:2;jenkins-hbase17:35055] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 21:51:08,503 INFO [RS:2;jenkins-hbase17:35055] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 21:51:08,503 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:51:08,505 INFO [RS:2;jenkins-hbase17:35055] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35055 2023-07-11 21:51:08,551 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:51:08,551 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:51:08,551 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:51:08,551 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:51:08,551 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:51:08,551 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35055,1689112018269 2023-07-11 21:51:08,551 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:51:08,552 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,35055,1689112018269] 2023-07-11 21:51:08,558 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,35055,1689112018269; numProcessing=1 2023-07-11 21:51:08,559 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,35055,1689112018269 already deleted, retry=false 2023-07-11 21:51:08,559 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,35055,1689112018269 expired; onlineServers=2 2023-07-11 21:51:08,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/.tmp/rep_barrier/0a9f3c6eca1a4728ab8feb11d8ca78e3 2023-07-11 21:51:08,587 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a9f3c6eca1a4728ab8feb11d8ca78e3 2023-07-11 21:51:08,613 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 21:51:08,613 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 21:51:08,661 DEBUG [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 21:51:08,666 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,46731,1689112018018; all regions closed. 2023-07-11 21:51:08,668 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:51:08,668 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x10156596b270003, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:51:08,668 INFO [RS:2;jenkins-hbase17:35055] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35055,1689112018269; zookeeper connection closed. 2023-07-11 21:51:08,677 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f309f8d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f309f8d 2023-07-11 21:51:08,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/.tmp/table/9d40eac6e4d44d8d9f1a4b8588b1fab6 2023-07-11 21:51:08,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d40eac6e4d44d8d9f1a4b8588b1fab6 2023-07-11 21:51:08,695 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/.tmp/info/2cc95f6f1cc644d1964057e8f4f9eaa8 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/info/2cc95f6f1cc644d1964057e8f4f9eaa8 2023-07-11 21:51:08,697 DEBUG [RS:0;jenkins-hbase17:46731] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/oldWALs 2023-07-11 21:51:08,697 INFO [RS:0;jenkins-hbase17:46731] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C46731%2C1689112018018:(num 1689112021827) 2023-07-11 21:51:08,697 DEBUG [RS:0;jenkins-hbase17:46731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,697 INFO [RS:0;jenkins-hbase17:46731] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:51:08,697 INFO [RS:0;jenkins-hbase17:46731] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 21:51:08,698 INFO [RS:0;jenkins-hbase17:46731] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 21:51:08,698 INFO [RS:0;jenkins-hbase17:46731] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 21:51:08,698 INFO [RS:0;jenkins-hbase17:46731] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 21:51:08,698 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:51:08,700 INFO [RS:0;jenkins-hbase17:46731] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:46731 2023-07-11 21:51:08,702 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:51:08,702 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:51:08,702 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,46731,1689112018018 2023-07-11 21:51:08,702 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,46731,1689112018018] 2023-07-11 21:51:08,702 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,46731,1689112018018; numProcessing=2 2023-07-11 21:51:08,704 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,46731,1689112018018 already deleted, retry=false 2023-07-11 21:51:08,704 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,46731,1689112018018 expired; onlineServers=1 2023-07-11 21:51:08,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cc95f6f1cc644d1964057e8f4f9eaa8 2023-07-11 21:51:08,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/info/2cc95f6f1cc644d1964057e8f4f9eaa8, entries=48, sequenceid=131, filesize=10.3 K 2023-07-11 21:51:08,708 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/.tmp/rep_barrier/0a9f3c6eca1a4728ab8feb11d8ca78e3 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/rep_barrier/0a9f3c6eca1a4728ab8feb11d8ca78e3 2023-07-11 21:51:08,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a9f3c6eca1a4728ab8feb11d8ca78e3 2023-07-11 21:51:08,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/rep_barrier/0a9f3c6eca1a4728ab8feb11d8ca78e3, entries=13, sequenceid=131, filesize=6.4 K 2023-07-11 21:51:08,725 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/.tmp/table/9d40eac6e4d44d8d9f1a4b8588b1fab6 as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/table/9d40eac6e4d44d8d9f1a4b8588b1fab6 2023-07-11 21:51:08,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d40eac6e4d44d8d9f1a4b8588b1fab6 2023-07-11 21:51:08,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/table/9d40eac6e4d44d8d9f1a4b8588b1fab6, entries=24, sequenceid=131, filesize=6.9 K 2023-07-11 21:51:08,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 659ms, sequenceid=131, compaction requested=false 2023-07-11 21:51:08,780 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-11 21:51:08,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:51:08,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:51:08,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:51:08,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:51:08,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 21:51:08,804 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:51:08,804 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x10156596b270001, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:51:08,805 INFO [RS:0;jenkins-hbase17:46731] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,46731,1689112018018; zookeeper connection closed. 2023-07-11 21:51:08,820 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@23faea49] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@23faea49 2023-07-11 21:51:08,868 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,34193,1689112018101; all regions closed. 2023-07-11 21:51:08,919 DEBUG [RS:1;jenkins-hbase17:34193] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/oldWALs 2023-07-11 21:51:08,919 INFO [RS:1;jenkins-hbase17:34193] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C34193%2C1689112018101.meta:.meta(num 1689112022198) 2023-07-11 21:51:08,951 DEBUG [RS:1;jenkins-hbase17:34193] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/oldWALs 2023-07-11 21:51:08,951 INFO [RS:1;jenkins-hbase17:34193] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C34193%2C1689112018101:(num 1689112021809) 2023-07-11 21:51:08,951 DEBUG [RS:1;jenkins-hbase17:34193] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,951 INFO [RS:1;jenkins-hbase17:34193] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:51:08,951 INFO [RS:1;jenkins-hbase17:34193] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 21:51:08,951 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:51:08,953 INFO [RS:1;jenkins-hbase17:34193] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:34193 2023-07-11 21:51:08,955 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:51:08,955 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,34193,1689112018101 2023-07-11 21:51:08,957 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,34193,1689112018101] 2023-07-11 21:51:08,957 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,34193,1689112018101; numProcessing=3 2023-07-11 21:51:08,957 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,34193,1689112018101 already deleted, retry=false 2023-07-11 21:51:08,957 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,34193,1689112018101 expired; onlineServers=0 2023-07-11 21:51:08,957 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,44551,1689112016009' ***** 2023-07-11 21:51:08,958 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 21:51:08,958 DEBUG [M:0;jenkins-hbase17:44551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1db40444, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-11 21:51:08,958 INFO [M:0;jenkins-hbase17:44551] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,44551,1689112016009 2023-07-11 21:51:08,958 INFO [M:0;jenkins-hbase17:44551] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,44551,1689112016009; all regions closed. 2023-07-11 21:51:08,958 DEBUG [M:0;jenkins-hbase17:44551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:51:08,958 DEBUG [M:0;jenkins-hbase17:44551] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 21:51:08,958 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 21:51:08,958 DEBUG [M:0;jenkins-hbase17:44551] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 21:51:08,958 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689112020875] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689112020875,5,FailOnTimeoutGroup] 2023-07-11 21:51:08,958 INFO [M:0;jenkins-hbase17:44551] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 21:51:08,958 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689112020876] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689112020876,5,FailOnTimeoutGroup] 2023-07-11 21:51:08,959 INFO [M:0;jenkins-hbase17:44551] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 21:51:08,959 INFO [M:0;jenkins-hbase17:44551] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-11 21:51:08,959 DEBUG [M:0;jenkins-hbase17:44551] master.HMaster(1512): Stopping service threads 2023-07-11 21:51:08,959 INFO [M:0;jenkins-hbase17:44551] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 21:51:08,960 ERROR [M:0;jenkins-hbase17:44551] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-27,5,PEWorkerGroup] Thread[HFileArchiver-28,5,PEWorkerGroup] 2023-07-11 21:51:08,960 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 21:51:08,960 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:51:08,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:51:08,960 INFO [M:0;jenkins-hbase17:44551] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 21:51:08,961 DEBUG [M:0;jenkins-hbase17:44551] zookeeper.ZKUtil(398): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 21:51:08,961 WARN [M:0;jenkins-hbase17:44551] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 21:51:08,961 INFO [M:0;jenkins-hbase17:44551] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 21:51:08,961 INFO [M:0;jenkins-hbase17:44551] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 21:51:08,962 DEBUG [M:0;jenkins-hbase17:44551] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:51:08,963 INFO [M:0;jenkins-hbase17:44551] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:51:08,963 DEBUG [M:0;jenkins-hbase17:44551] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:51:08,963 DEBUG [M:0;jenkins-hbase17:44551] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:51:08,963 DEBUG [M:0;jenkins-hbase17:44551] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:51:08,963 INFO [M:0;jenkins-hbase17:44551] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.31 KB heapSize=452.51 KB 2023-07-11 21:51:08,964 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 21:51:09,057 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:51:09,057 INFO [RS:1;jenkins-hbase17:34193] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,34193,1689112018101; zookeeper connection closed. 2023-07-11 21:51:09,057 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): regionserver:34193-0x10156596b270002, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:51:09,067 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4eaa1f29] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4eaa1f29 2023-07-11 21:51:09,067 INFO [Listener at jenkins-hbase17.apache.org/33347] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-11 21:51:09,468 INFO [M:0;jenkins-hbase17:44551] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.31 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2000f42a818c4fd193449f3796ef149c 2023-07-11 21:51:09,473 INFO [M:0;jenkins-hbase17:44551] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2000f42a818c4fd193449f3796ef149c 2023-07-11 21:51:09,476 DEBUG [M:0;jenkins-hbase17:44551] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2000f42a818c4fd193449f3796ef149c as hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2000f42a818c4fd193449f3796ef149c 2023-07-11 21:51:09,483 INFO [M:0;jenkins-hbase17:44551] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2000f42a818c4fd193449f3796ef149c 2023-07-11 21:51:09,483 INFO [M:0;jenkins-hbase17:44551] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37147/user/jenkins/test-data/218cd832-f3bf-479a-6cc6-a4b323f6014e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2000f42a818c4fd193449f3796ef149c, entries=119, sequenceid=899, filesize=28.7 K 2023-07-11 21:51:09,485 INFO [M:0;jenkins-hbase17:44551] regionserver.HRegion(2948): Finished flush of dataSize ~376.31 KB/385346, heapSize ~452.49 KB/463352, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 522ms, sequenceid=899, compaction requested=false 2023-07-11 21:51:09,497 INFO [M:0;jenkins-hbase17:44551] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:51:09,497 DEBUG [M:0;jenkins-hbase17:44551] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:51:09,518 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:51:09,518 INFO [M:0;jenkins-hbase17:44551] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 21:51:09,519 INFO [M:0;jenkins-hbase17:44551] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:44551 2023-07-11 21:51:09,521 DEBUG [M:0;jenkins-hbase17:44551] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,44551,1689112016009 already deleted, retry=false 2023-07-11 21:51:09,624 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:51:09,624 DEBUG [Listener at localhost.localdomain/45553-EventThread] zookeeper.ZKWatcher(600): master:44551-0x10156596b270000, quorum=127.0.0.1:59736, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:51:09,624 INFO [M:0;jenkins-hbase17:44551] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,44551,1689112016009; zookeeper connection closed. 2023-07-11 21:51:09,627 WARN [Listener at jenkins-hbase17.apache.org/33347] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:51:09,635 WARN [BP-849993990-136.243.18.41-1689112010272 heartbeating to localhost.localdomain/127.0.0.1:37147] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-849993990-136.243.18.41-1689112010272 (Datanode Uuid e82a7423-cd26-4c1b-973a-6f20afe38158) service to localhost.localdomain/127.0.0.1:37147 2023-07-11 21:51:09,647 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data5/current/BP-849993990-136.243.18.41-1689112010272] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:51:09,660 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data6/current/BP-849993990-136.243.18.41-1689112010272] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:51:09,715 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:51:09,729 WARN [Listener at jenkins-hbase17.apache.org/33347] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:51:09,797 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:51:09,901 WARN [BP-849993990-136.243.18.41-1689112010272 heartbeating to localhost.localdomain/127.0.0.1:37147] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:51:09,901 WARN [BP-849993990-136.243.18.41-1689112010272 heartbeating to localhost.localdomain/127.0.0.1:37147] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-849993990-136.243.18.41-1689112010272 (Datanode Uuid 3bf1af91-b830-442b-a411-c6bb229fbbf7) service to localhost.localdomain/127.0.0.1:37147 2023-07-11 21:51:09,902 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data3/current/BP-849993990-136.243.18.41-1689112010272] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:51:09,902 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data4/current/BP-849993990-136.243.18.41-1689112010272] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:51:09,904 WARN [Listener at jenkins-hbase17.apache.org/33347] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:51:09,942 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:51:10,048 WARN [BP-849993990-136.243.18.41-1689112010272 heartbeating to localhost.localdomain/127.0.0.1:37147] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:51:10,048 WARN [BP-849993990-136.243.18.41-1689112010272 heartbeating to localhost.localdomain/127.0.0.1:37147] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-849993990-136.243.18.41-1689112010272 (Datanode Uuid c091bb12-e372-4d16-8f2e-68039060b54c) service to localhost.localdomain/127.0.0.1:37147 2023-07-11 21:51:10,049 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data1/current/BP-849993990-136.243.18.41-1689112010272] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:51:10,050 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/472e2d94-8b73-bcf5-7225-f866d4c2cde8/cluster_3f0bb0d7-2b9c-90d5-2ae4-9dabeab2edfb/dfs/data/data2/current/BP-849993990-136.243.18.41-1689112010272] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:51:10,088 INFO [Listener at jenkins-hbase17.apache.org/33347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-11 21:51:10,150 INFO [Listener at jenkins-hbase17.apache.org/33347] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 21:51:10,449 INFO [Listener at jenkins-hbase17.apache.org/33347] hbase.HBaseTestingUtility(1293): Minicluster is down