2023-09-17 17:00:59,886 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-17 17:01:00,121 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e 2023-09-17 17:01:00,121 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-17 17:01:00,122 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-17 17:01:00,161 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-17 17:01:00,377 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-17 17:01:00,378 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7, deleteOnExit=true 2023-09-17 17:01:00,378 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-17 17:01:00,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/test.cache.data in system properties and HBase conf 2023-09-17 17:01:00,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop.tmp.dir in system properties and HBase conf 2023-09-17 17:01:00,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop.log.dir in system properties and HBase conf 2023-09-17 17:01:00,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-17 17:01:00,380 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-17 17:01:00,380 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-17 17:01:00,699 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-17 17:01:00,705 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-17 17:01:00,705 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-17 17:01:00,705 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-17 17:01:00,706 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-17 17:01:00,706 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-17 17:01:00,706 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-17 17:01:00,707 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-17 17:01:00,707 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-17 17:01:00,707 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-17 17:01:00,708 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/nfs.dump.dir in system properties and HBase conf 2023-09-17 17:01:00,708 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir in system properties and HBase conf 2023-09-17 17:01:00,709 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-17 17:01:00,709 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-17 17:01:00,710 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-17 17:01:01,230 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-17 17:01:01,234 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-17 17:01:01,551 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-17 17:01:01,712 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-17 17:01:01,725 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 17:01:01,763 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 17:01:01,798 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir/Jetty_localhost_41573_hdfs____.18h1ya/webapp 2023-09-17 17:01:01,936 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41573 2023-09-17 17:01:01,976 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-17 17:01:01,976 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-17 17:01:02,445 WARN [Listener at localhost/35449] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-17 17:01:02,526 WARN [Listener at localhost/35449] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-17 17:01:02,547 WARN [Listener at localhost/35449] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 17:01:02,553 INFO [Listener at localhost/35449] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 17:01:02,562 INFO [Listener at localhost/35449] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir/Jetty_localhost_38299_datanode____.3s5rgs/webapp 2023-09-17 17:01:02,665 INFO [Listener at localhost/35449] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38299 2023-09-17 17:01:03,120 WARN [Listener at localhost/33957] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-17 17:01:03,133 WARN [Listener at localhost/33957] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-17 17:01:03,136 WARN [Listener at localhost/33957] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 17:01:03,137 INFO [Listener at localhost/33957] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 17:01:03,146 INFO [Listener at localhost/33957] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir/Jetty_localhost_44673_datanode____.f5lu6f/webapp 2023-09-17 17:01:03,247 INFO [Listener at localhost/33957] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44673 2023-09-17 17:01:03,255 WARN [Listener at localhost/33701] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-17 17:01:03,273 WARN [Listener at localhost/33701] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-17 17:01:03,276 WARN [Listener at localhost/33701] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 17:01:03,279 INFO [Listener at localhost/33701] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 17:01:03,287 INFO [Listener at localhost/33701] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir/Jetty_localhost_43043_datanode____au80jb/webapp 2023-09-17 17:01:03,399 INFO [Listener at localhost/33701] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43043 2023-09-17 17:01:03,408 WARN [Listener at localhost/37077] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-17 17:01:03,686 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe4ab1f51cf7157bc: Processing first storage report for DS-84039463-baa2-4e98-b803-7d42659efa31 from datanode b549da05-a7c2-4e21-aa6c-7e9fbd5b6e21 2023-09-17 17:01:03,689 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe4ab1f51cf7157bc: from storage DS-84039463-baa2-4e98-b803-7d42659efa31 node DatanodeRegistration(127.0.0.1:35435, datanodeUuid=b549da05-a7c2-4e21-aa6c-7e9fbd5b6e21, infoPort=44759, infoSecurePort=0, ipcPort=33701, storageInfo=lv=-57;cid=testClusterID;nsid=1215118504;c=1694970061314), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-17 17:01:03,689 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x41da225a35c747bd: Processing first storage report for DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed from datanode 9a8fe709-bfe5-4167-9df4-cc0d840b12b7 2023-09-17 17:01:03,689 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x41da225a35c747bd: from storage DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed node DatanodeRegistration(127.0.0.1:40639, datanodeUuid=9a8fe709-bfe5-4167-9df4-cc0d840b12b7, infoPort=33463, infoSecurePort=0, ipcPort=33957, storageInfo=lv=-57;cid=testClusterID;nsid=1215118504;c=1694970061314), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-17 17:01:03,690 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f357fa62823079f: Processing first storage report for DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b from datanode 28e4a497-8bda-4033-b57e-e0f08b6640fb 2023-09-17 17:01:03,690 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f357fa62823079f: from storage DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b node DatanodeRegistration(127.0.0.1:45705, datanodeUuid=28e4a497-8bda-4033-b57e-e0f08b6640fb, infoPort=34779, infoSecurePort=0, ipcPort=37077, storageInfo=lv=-57;cid=testClusterID;nsid=1215118504;c=1694970061314), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 17:01:03,690 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe4ab1f51cf7157bc: Processing first storage report for DS-e6f5668d-d310-40f3-b02f-3a3baf80d40e from datanode b549da05-a7c2-4e21-aa6c-7e9fbd5b6e21 2023-09-17 17:01:03,690 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe4ab1f51cf7157bc: from storage DS-e6f5668d-d310-40f3-b02f-3a3baf80d40e node DatanodeRegistration(127.0.0.1:35435, datanodeUuid=b549da05-a7c2-4e21-aa6c-7e9fbd5b6e21, infoPort=44759, infoSecurePort=0, ipcPort=33701, storageInfo=lv=-57;cid=testClusterID;nsid=1215118504;c=1694970061314), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 17:01:03,690 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x41da225a35c747bd: Processing first storage report for DS-c1fb0c70-7c7e-4d8b-aa7f-25b9e88f778c from datanode 9a8fe709-bfe5-4167-9df4-cc0d840b12b7 2023-09-17 17:01:03,690 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x41da225a35c747bd: from storage DS-c1fb0c70-7c7e-4d8b-aa7f-25b9e88f778c node DatanodeRegistration(127.0.0.1:40639, datanodeUuid=9a8fe709-bfe5-4167-9df4-cc0d840b12b7, infoPort=33463, infoSecurePort=0, ipcPort=33957, storageInfo=lv=-57;cid=testClusterID;nsid=1215118504;c=1694970061314), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 17:01:03,691 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f357fa62823079f: Processing first storage report for DS-f5f65bb4-3cc4-4027-9492-f508f2f2fbd9 from datanode 28e4a497-8bda-4033-b57e-e0f08b6640fb 2023-09-17 17:01:03,691 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f357fa62823079f: from storage DS-f5f65bb4-3cc4-4027-9492-f508f2f2fbd9 node DatanodeRegistration(127.0.0.1:45705, datanodeUuid=28e4a497-8bda-4033-b57e-e0f08b6640fb, infoPort=34779, infoSecurePort=0, ipcPort=37077, storageInfo=lv=-57;cid=testClusterID;nsid=1215118504;c=1694970061314), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 17:01:03,915 DEBUG [Listener at localhost/37077] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e 2023-09-17 17:01:04,020 INFO [Listener at localhost/37077] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/zookeeper_0, clientPort=59728, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-17 17:01:04,041 INFO [Listener at localhost/37077] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59728 2023-09-17 17:01:04,049 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:04,051 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:04,752 INFO [Listener at localhost/37077] util.FSUtils(471): Created version file at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 with version=8 2023-09-17 17:01:04,753 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/hbase-staging 2023-09-17 17:01:05,150 INFO [Listener at localhost/37077] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-17 17:01:05,610 INFO [Listener at localhost/37077] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-17 17:01:05,643 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:05,643 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:05,644 INFO [Listener at localhost/37077] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-17 17:01:05,644 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:05,644 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-17 17:01:05,784 INFO [Listener at localhost/37077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-17 17:01:05,856 DEBUG [Listener at localhost/37077] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-17 17:01:05,948 INFO [Listener at localhost/37077] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36669 2023-09-17 17:01:05,961 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:05,963 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:05,986 INFO [Listener at localhost/37077] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36669 connecting to ZooKeeper ensemble=127.0.0.1:59728 2023-09-17 17:01:06,041 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:366690x0, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-17 17:01:06,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36669-0x100bad5e4210000 connected 2023-09-17 17:01:06,073 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 17:01:06,073 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 17:01:06,087 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-17 17:01:06,095 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36669 2023-09-17 17:01:06,097 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36669 2023-09-17 17:01:06,097 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36669 2023-09-17 17:01:06,098 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36669 2023-09-17 17:01:06,098 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36669 2023-09-17 17:01:06,104 INFO [Listener at localhost/37077] master.HMaster(444): hbase.rootdir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3, hbase.cluster.distributed=false 2023-09-17 17:01:06,169 INFO [Listener at localhost/37077] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-17 17:01:06,169 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,169 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,170 INFO [Listener at localhost/37077] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-17 17:01:06,170 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,170 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-17 17:01:06,175 INFO [Listener at localhost/37077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-17 17:01:06,178 INFO [Listener at localhost/37077] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46223 2023-09-17 17:01:06,180 INFO [Listener at localhost/37077] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-17 17:01:06,187 INFO [Listener at localhost/37077] mob.MobFileCache(124): MobFileCache disabled 2023-09-17 17:01:06,188 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:06,190 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:06,192 INFO [Listener at localhost/37077] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46223 connecting to ZooKeeper ensemble=127.0.0.1:59728 2023-09-17 17:01:06,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:462230x0, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-17 17:01:06,201 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:462230x0, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 17:01:06,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46223-0x100bad5e4210001 connected 2023-09-17 17:01:06,202 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 17:01:06,203 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-17 17:01:06,204 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46223 2023-09-17 17:01:06,204 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46223 2023-09-17 17:01:06,204 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46223 2023-09-17 17:01:06,205 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46223 2023-09-17 17:01:06,205 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46223 2023-09-17 17:01:06,218 INFO [Listener at localhost/37077] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-17 17:01:06,218 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,218 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,219 INFO [Listener at localhost/37077] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-17 17:01:06,219 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,219 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-17 17:01:06,219 INFO [Listener at localhost/37077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-17 17:01:06,221 INFO [Listener at localhost/37077] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35553 2023-09-17 17:01:06,221 INFO [Listener at localhost/37077] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-17 17:01:06,223 INFO [Listener at localhost/37077] mob.MobFileCache(124): MobFileCache disabled 2023-09-17 17:01:06,223 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:06,226 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:06,228 INFO [Listener at localhost/37077] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35553 connecting to ZooKeeper ensemble=127.0.0.1:59728 2023-09-17 17:01:06,235 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:355530x0, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-17 17:01:06,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35553-0x100bad5e4210002 connected 2023-09-17 17:01:06,237 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 17:01:06,237 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 17:01:06,238 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-17 17:01:06,241 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35553 2023-09-17 17:01:06,241 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35553 2023-09-17 17:01:06,245 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35553 2023-09-17 17:01:06,245 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35553 2023-09-17 17:01:06,245 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35553 2023-09-17 17:01:06,257 INFO [Listener at localhost/37077] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-17 17:01:06,258 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,258 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,258 INFO [Listener at localhost/37077] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-17 17:01:06,258 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 17:01:06,258 INFO [Listener at localhost/37077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-17 17:01:06,258 INFO [Listener at localhost/37077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-17 17:01:06,260 INFO [Listener at localhost/37077] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42773 2023-09-17 17:01:06,260 INFO [Listener at localhost/37077] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-17 17:01:06,261 INFO [Listener at localhost/37077] mob.MobFileCache(124): MobFileCache disabled 2023-09-17 17:01:06,262 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:06,263 INFO [Listener at localhost/37077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:06,265 INFO [Listener at localhost/37077] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42773 connecting to ZooKeeper ensemble=127.0.0.1:59728 2023-09-17 17:01:06,268 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:427730x0, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-17 17:01:06,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42773-0x100bad5e4210003 connected 2023-09-17 17:01:06,269 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 17:01:06,270 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 17:01:06,271 DEBUG [Listener at localhost/37077] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-17 17:01:06,273 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42773 2023-09-17 17:01:06,273 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42773 2023-09-17 17:01:06,275 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42773 2023-09-17 17:01:06,276 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42773 2023-09-17 17:01:06,276 DEBUG [Listener at localhost/37077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42773 2023-09-17 17:01:06,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:01:06,290 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-17 17:01:06,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:01:06,311 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-17 17:01:06,311 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-17 17:01:06,311 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-17 17:01:06,311 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-17 17:01:06,311 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:06,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-17 17:01:06,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-17 17:01:06,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36669,1694970064919 from backup master directory 2023-09-17 17:01:06,320 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:01:06,320 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-17 17:01:06,321 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-17 17:01:06,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:01:06,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-17 17:01:06,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-17 17:01:06,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/hbase.id with ID: efd4d888-d12b-4c38-b9ab-2a45e5a5781a 2023-09-17 17:01:06,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 17:01:06,476 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:06,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4722c790 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:06,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@692f048f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:06,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-17 17:01:06,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-17 17:01:06,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-17 17:01:06,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-17 17:01:06,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-17 17:01:06,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-17 17:01:06,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 17:01:06,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store-tmp 2023-09-17 17:01:06,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:06,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-17 17:01:06,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 17:01:06,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 17:01:06,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-17 17:01:06,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 17:01:06,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 17:01:06,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-17 17:01:06,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/WALs/jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:01:06,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36669%2C1694970064919, suffix=, logDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/WALs/jenkins-hbase4.apache.org,36669,1694970064919, archiveDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/oldWALs, maxLogs=10 2023-09-17 17:01:06,791 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK] 2023-09-17 17:01:06,791 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK] 2023-09-17 17:01:06,791 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK] 2023-09-17 17:01:06,801 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-17 17:01:06,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/WALs/jenkins-hbase4.apache.org,36669,1694970064919/jenkins-hbase4.apache.org%2C36669%2C1694970064919.1694970066736 2023-09-17 17:01:06,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK]] 2023-09-17 17:01:06,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-17 17:01:06,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:06,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-17 17:01:06,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-17 17:01:06,955 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-17 17:01:06,961 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-17 17:01:06,989 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-17 17:01:07,002 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:07,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-17 17:01:07,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-17 17:01:07,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-17 17:01:07,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:07,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59320228, jitterRate=-0.11605972051620483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:07,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-17 17:01:07,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-17 17:01:07,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-17 17:01:07,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-17 17:01:07,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-17 17:01:07,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-17 17:01:07,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-17 17:01:07,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-17 17:01:07,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-17 17:01:07,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-17 17:01:07,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-17 17:01:07,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-17 17:01:07,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-17 17:01:07,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-17 17:01:07,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-17 17:01:07,175 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:07,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-17 17:01:07,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-17 17:01:07,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-17 17:01:07,196 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-17 17:01:07,196 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-17 17:01:07,196 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:07,196 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-17 17:01:07,196 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-17 17:01:07,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36669,1694970064919, sessionid=0x100bad5e4210000, setting cluster-up flag (Was=false) 2023-09-17 17:01:07,215 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:07,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-17 17:01:07,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:01:07,229 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:07,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-17 17:01:07,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:01:07,238 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp 2023-09-17 17:01:07,281 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(951): ClusterId : efd4d888-d12b-4c38-b9ab-2a45e5a5781a 2023-09-17 17:01:07,282 INFO [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(951): ClusterId : efd4d888-d12b-4c38-b9ab-2a45e5a5781a 2023-09-17 17:01:07,281 INFO [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(951): ClusterId : efd4d888-d12b-4c38-b9ab-2a45e5a5781a 2023-09-17 17:01:07,290 DEBUG [RS:0;jenkins-hbase4:46223] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-17 17:01:07,290 DEBUG [RS:1;jenkins-hbase4:35553] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-17 17:01:07,290 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-17 17:01:07,298 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-17 17:01:07,298 DEBUG [RS:0;jenkins-hbase4:46223] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-17 17:01:07,298 DEBUG [RS:1;jenkins-hbase4:35553] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-17 17:01:07,298 DEBUG [RS:0;jenkins-hbase4:46223] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-17 17:01:07,298 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-17 17:01:07,298 DEBUG [RS:1;jenkins-hbase4:35553] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-17 17:01:07,303 DEBUG [RS:1;jenkins-hbase4:35553] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-17 17:01:07,303 DEBUG [RS:0;jenkins-hbase4:46223] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-17 17:01:07,306 DEBUG [RS:1;jenkins-hbase4:35553] zookeeper.ReadOnlyZKClient(139): Connect 0x309db57c to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:07,309 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-17 17:01:07,310 DEBUG [RS:0;jenkins-hbase4:46223] zookeeper.ReadOnlyZKClient(139): Connect 0x4ec81448 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:07,313 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ReadOnlyZKClient(139): Connect 0x29c90dff to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:07,326 DEBUG [RS:1;jenkins-hbase4:35553] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e5a5d1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:07,328 DEBUG [RS:1;jenkins-hbase4:35553] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a65de0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-17 17:01:07,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-17 17:01:07,333 DEBUG [RS:2;jenkins-hbase4:42773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@270ee6b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:07,333 DEBUG [RS:2;jenkins-hbase4:42773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2331668f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-17 17:01:07,360 DEBUG [RS:0;jenkins-hbase4:46223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@400fe3e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:07,361 DEBUG [RS:0;jenkins-hbase4:46223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44307f38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-17 17:01:07,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:07,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-17 17:01:07,383 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46223 2023-09-17 17:01:07,385 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35553 2023-09-17 17:01:07,385 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42773 2023-09-17 17:01:07,388 INFO [RS:0;jenkins-hbase4:46223] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-17 17:01:07,388 INFO [RS:1;jenkins-hbase4:35553] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-17 17:01:07,389 INFO [RS:0;jenkins-hbase4:46223] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-17 17:01:07,388 INFO [RS:2;jenkins-hbase4:42773] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-17 17:01:07,389 INFO [RS:1;jenkins-hbase4:35553] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-17 17:01:07,389 INFO [RS:2;jenkins-hbase4:42773] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-17 17:01:07,389 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-17 17:01:07,389 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-17 17:01:07,389 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-17 17:01:07,390 INFO [RS:0;jenkins-hbase4:46223] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:07,390 INFO [RS:1;jenkins-hbase4:35553] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:07,390 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1022): About to register with Master. 2023-09-17 17:01:07,390 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1022): About to register with Master. 2023-09-17 17:01:07,390 INFO [RS:2;jenkins-hbase4:42773] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:07,390 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1022): About to register with Master. 2023-09-17 17:01:07,393 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36669,1694970064919 with isa=jenkins-hbase4.apache.org/172.31.14.131:42773, startcode=1694970066257 2023-09-17 17:01:07,393 INFO [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36669,1694970064919 with isa=jenkins-hbase4.apache.org/172.31.14.131:35553, startcode=1694970066217 2023-09-17 17:01:07,393 INFO [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36669,1694970064919 with isa=jenkins-hbase4.apache.org/172.31.14.131:46223, startcode=1694970066168 2023-09-17 17:01:07,413 DEBUG [RS:1;jenkins-hbase4:35553] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-17 17:01:07,413 DEBUG [RS:0;jenkins-hbase4:46223] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-17 17:01:07,413 DEBUG [RS:2;jenkins-hbase4:42773] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-17 17:01:07,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-17 17:01:07,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-17 17:01:07,471 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43367, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-17 17:01:07,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-17 17:01:07,471 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38973, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-17 17:01:07,471 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44181, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-17 17:01:07,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-17 17:01:07,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-17 17:01:07,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-17 17:01:07,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-17 17:01:07,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694970097475 2023-09-17 17:01:07,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-17 17:01:07,482 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36669] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-17 17:01:07,483 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-17 17:01:07,484 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-17 17:01:07,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-17 17:01:07,489 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-17 17:01:07,492 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36669] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-17 17:01:07,493 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36669] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-17 17:01:07,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-17 17:01:07,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-17 17:01:07,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-17 17:01:07,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-17 17:01:07,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-17 17:01:07,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-17 17:01:07,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-17 17:01:07,518 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(2830): Master is not running yet 2023-09-17 17:01:07,518 WARN [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-17 17:01:07,518 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(2830): Master is not running yet 2023-09-17 17:01:07,518 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(2830): Master is not running yet 2023-09-17 17:01:07,519 WARN [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-17 17:01:07,519 WARN [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-17 17:01:07,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-17 17:01:07,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-17 17:01:07,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694970067523,5,FailOnTimeoutGroup] 2023-09-17 17:01:07,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694970067523,5,FailOnTimeoutGroup] 2023-09-17 17:01:07,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-17 17:01:07,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,540 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-17 17:01:07,541 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-17 17:01:07,541 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:07,563 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:07,565 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-17 17:01:07,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/info 2023-09-17 17:01:07,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-17 17:01:07,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:07,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-17 17:01:07,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/rep_barrier 2023-09-17 17:01:07,573 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-17 17:01:07,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:07,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-17 17:01:07,576 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/table 2023-09-17 17:01:07,577 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-17 17:01:07,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:07,579 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740 2023-09-17 17:01:07,580 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740 2023-09-17 17:01:07,584 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-17 17:01:07,587 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-17 17:01:07,590 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:07,591 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63725949, jitterRate=-0.050409361720085144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-17 17:01:07,591 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-17 17:01:07,591 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-17 17:01:07,592 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-17 17:01:07,592 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-17 17:01:07,592 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-17 17:01:07,592 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-17 17:01:07,594 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-17 17:01:07,594 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-17 17:01:07,599 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-17 17:01:07,599 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-17 17:01:07,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-17 17:01:07,619 INFO [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36669,1694970064919 with isa=jenkins-hbase4.apache.org/172.31.14.131:46223, startcode=1694970066168 2023-09-17 17:01:07,620 INFO [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36669,1694970064919 with isa=jenkins-hbase4.apache.org/172.31.14.131:35553, startcode=1694970066217 2023-09-17 17:01:07,620 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36669,1694970064919 with isa=jenkins-hbase4.apache.org/172.31.14.131:42773, startcode=1694970066257 2023-09-17 17:01:07,625 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-17 17:01:07,627 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36669] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:07,629 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-17 17:01:07,634 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36669] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:07,635 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:07,635 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35449 2023-09-17 17:01:07,636 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-17 17:01:07,636 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36669] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:07,636 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:07,636 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35449 2023-09-17 17:01:07,636 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-17 17:01:07,638 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:07,638 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35449 2023-09-17 17:01:07,638 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-17 17:01:07,649 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 17:01:07,649 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ZKUtil(162): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:07,649 DEBUG [RS:1;jenkins-hbase4:35553] zookeeper.ZKUtil(162): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:07,649 WARN [RS:2;jenkins-hbase4:42773] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-17 17:01:07,649 WARN [RS:1;jenkins-hbase4:35553] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-17 17:01:07,650 INFO [RS:2;jenkins-hbase4:42773] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 17:01:07,649 DEBUG [RS:0;jenkins-hbase4:46223] zookeeper.ZKUtil(162): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:07,650 INFO [RS:1;jenkins-hbase4:35553] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 17:01:07,651 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:07,651 WARN [RS:0;jenkins-hbase4:46223] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-17 17:01:07,651 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:07,652 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35553,1694970066217] 2023-09-17 17:01:07,652 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46223,1694970066168] 2023-09-17 17:01:07,652 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42773,1694970066257] 2023-09-17 17:01:07,651 INFO [RS:0;jenkins-hbase4:46223] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 17:01:07,652 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:07,669 DEBUG [RS:0;jenkins-hbase4:46223] zookeeper.ZKUtil(162): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:07,669 DEBUG [RS:1;jenkins-hbase4:35553] zookeeper.ZKUtil(162): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:07,669 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ZKUtil(162): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:07,670 DEBUG [RS:0;jenkins-hbase4:46223] zookeeper.ZKUtil(162): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:07,670 DEBUG [RS:1;jenkins-hbase4:35553] zookeeper.ZKUtil(162): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:07,670 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ZKUtil(162): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:07,671 DEBUG [RS:0;jenkins-hbase4:46223] zookeeper.ZKUtil(162): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:07,671 DEBUG [RS:1;jenkins-hbase4:35553] zookeeper.ZKUtil(162): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:07,671 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ZKUtil(162): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:07,683 DEBUG [RS:0;jenkins-hbase4:46223] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-17 17:01:07,683 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-17 17:01:07,683 DEBUG [RS:1;jenkins-hbase4:35553] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-17 17:01:07,694 INFO [RS:0;jenkins-hbase4:46223] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-17 17:01:07,695 INFO [RS:1;jenkins-hbase4:35553] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-17 17:01:07,694 INFO [RS:2;jenkins-hbase4:42773] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-17 17:01:07,718 INFO [RS:1;jenkins-hbase4:35553] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-17 17:01:07,718 INFO [RS:2;jenkins-hbase4:42773] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-17 17:01:07,718 INFO [RS:0;jenkins-hbase4:46223] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-17 17:01:07,723 INFO [RS:0;jenkins-hbase4:46223] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-17 17:01:07,723 INFO [RS:2;jenkins-hbase4:42773] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-17 17:01:07,723 INFO [RS:0;jenkins-hbase4:46223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,723 INFO [RS:1;jenkins-hbase4:35553] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-17 17:01:07,723 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,724 INFO [RS:1;jenkins-hbase4:35553] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,724 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-17 17:01:07,725 INFO [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-17 17:01:07,724 INFO [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-17 17:01:07,733 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,733 INFO [RS:0;jenkins-hbase4:46223] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,733 INFO [RS:1;jenkins-hbase4:35553] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,733 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,733 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,734 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-17 17:01:07,734 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-17 17:01:07,735 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:1;jenkins-hbase4:35553] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:2;jenkins-hbase4:42773] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,735 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-17 17:01:07,736 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,736 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,736 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,736 DEBUG [RS:0;jenkins-hbase4:46223] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 17:01:07,738 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,738 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,738 INFO [RS:0;jenkins-hbase4:46223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,738 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,738 INFO [RS:0;jenkins-hbase4:46223] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,738 INFO [RS:1;jenkins-hbase4:35553] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,738 INFO [RS:0;jenkins-hbase4:46223] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,739 INFO [RS:1;jenkins-hbase4:35553] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,739 INFO [RS:1;jenkins-hbase4:35553] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,757 INFO [RS:2;jenkins-hbase4:42773] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-17 17:01:07,758 INFO [RS:0;jenkins-hbase4:46223] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-17 17:01:07,758 INFO [RS:1;jenkins-hbase4:35553] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-17 17:01:07,762 INFO [RS:1;jenkins-hbase4:35553] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35553,1694970066217-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,762 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42773,1694970066257-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,762 INFO [RS:0;jenkins-hbase4:46223] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46223,1694970066168-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:07,781 DEBUG [jenkins-hbase4:36669] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-17 17:01:07,782 INFO [RS:0;jenkins-hbase4:46223] regionserver.Replication(203): jenkins-hbase4.apache.org,46223,1694970066168 started 2023-09-17 17:01:07,782 INFO [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46223,1694970066168, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46223, sessionid=0x100bad5e4210001 2023-09-17 17:01:07,782 DEBUG [RS:0;jenkins-hbase4:46223] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-17 17:01:07,782 DEBUG [RS:0;jenkins-hbase4:46223] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:07,783 DEBUG [RS:0;jenkins-hbase4:46223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46223,1694970066168' 2023-09-17 17:01:07,783 DEBUG [RS:0;jenkins-hbase4:46223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-17 17:01:07,784 DEBUG [RS:0;jenkins-hbase4:46223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-17 17:01:07,784 DEBUG [RS:0;jenkins-hbase4:46223] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-17 17:01:07,784 DEBUG [RS:0;jenkins-hbase4:46223] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-17 17:01:07,784 DEBUG [RS:0;jenkins-hbase4:46223] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:07,784 DEBUG [RS:0;jenkins-hbase4:46223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46223,1694970066168' 2023-09-17 17:01:07,784 DEBUG [RS:0;jenkins-hbase4:46223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:07,785 DEBUG [RS:0;jenkins-hbase4:46223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:07,785 INFO [RS:1;jenkins-hbase4:35553] regionserver.Replication(203): jenkins-hbase4.apache.org,35553,1694970066217 started 2023-09-17 17:01:07,786 INFO [RS:2;jenkins-hbase4:42773] regionserver.Replication(203): jenkins-hbase4.apache.org,42773,1694970066257 started 2023-09-17 17:01:07,786 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42773,1694970066257, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42773, sessionid=0x100bad5e4210003 2023-09-17 17:01:07,786 DEBUG [RS:0;jenkins-hbase4:46223] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-17 17:01:07,786 INFO [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35553,1694970066217, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35553, sessionid=0x100bad5e4210002 2023-09-17 17:01:07,786 INFO [RS:0;jenkins-hbase4:46223] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-17 17:01:07,786 DEBUG [RS:1;jenkins-hbase4:35553] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-17 17:01:07,786 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-17 17:01:07,786 DEBUG [jenkins-hbase4:36669] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:01:07,787 DEBUG [RS:2;jenkins-hbase4:42773] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:07,786 DEBUG [RS:1;jenkins-hbase4:35553] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:07,786 INFO [RS:0;jenkins-hbase4:46223] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-17 17:01:07,788 DEBUG [RS:1;jenkins-hbase4:35553] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35553,1694970066217' 2023-09-17 17:01:07,788 DEBUG [RS:1;jenkins-hbase4:35553] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-17 17:01:07,787 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42773,1694970066257' 2023-09-17 17:01:07,788 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-17 17:01:07,789 DEBUG [RS:1;jenkins-hbase4:35553] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-17 17:01:07,789 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-17 17:01:07,790 DEBUG [RS:1;jenkins-hbase4:35553] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-17 17:01:07,790 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-17 17:01:07,790 DEBUG [RS:1;jenkins-hbase4:35553] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-17 17:01:07,790 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-17 17:01:07,790 DEBUG [RS:2;jenkins-hbase4:42773] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:07,790 DEBUG [RS:1;jenkins-hbase4:35553] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:07,791 DEBUG [RS:1;jenkins-hbase4:35553] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35553,1694970066217' 2023-09-17 17:01:07,791 DEBUG [RS:1;jenkins-hbase4:35553] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:07,791 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42773,1694970066257' 2023-09-17 17:01:07,791 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:07,791 DEBUG [RS:1;jenkins-hbase4:35553] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:07,791 DEBUG [RS:2;jenkins-hbase4:42773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:07,792 DEBUG [RS:1;jenkins-hbase4:35553] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-17 17:01:07,792 INFO [RS:1;jenkins-hbase4:35553] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-17 17:01:07,793 DEBUG [RS:2;jenkins-hbase4:42773] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-17 17:01:07,793 INFO [RS:1;jenkins-hbase4:35553] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-17 17:01:07,793 INFO [RS:2;jenkins-hbase4:42773] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-17 17:01:07,793 INFO [RS:2;jenkins-hbase4:42773] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-17 17:01:07,797 DEBUG [jenkins-hbase4:36669] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:01:07,797 DEBUG [jenkins-hbase4:36669] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:01:07,797 DEBUG [jenkins-hbase4:36669] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:01:07,797 DEBUG [jenkins-hbase4:36669] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:01:07,800 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42773,1694970066257, state=OPENING 2023-09-17 17:01:07,807 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-17 17:01:07,809 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:07,809 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-17 17:01:07,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:01:07,899 INFO [RS:1;jenkins-hbase4:35553] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35553%2C1694970066217, suffix=, logDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,35553,1694970066217, archiveDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/oldWALs, maxLogs=32 2023-09-17 17:01:07,899 INFO [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42773%2C1694970066257, suffix=, logDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,42773,1694970066257, archiveDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/oldWALs, maxLogs=32 2023-09-17 17:01:07,899 INFO [RS:0;jenkins-hbase4:46223] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46223%2C1694970066168, suffix=, logDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,46223,1694970066168, archiveDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/oldWALs, maxLogs=32 2023-09-17 17:01:07,924 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK] 2023-09-17 17:01:07,925 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK] 2023-09-17 17:01:07,925 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK] 2023-09-17 17:01:07,935 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK] 2023-09-17 17:01:07,935 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK] 2023-09-17 17:01:07,936 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK] 2023-09-17 17:01:07,944 INFO [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,42773,1694970066257/jenkins-hbase4.apache.org%2C42773%2C1694970066257.1694970067903 2023-09-17 17:01:07,945 DEBUG [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK], DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK]] 2023-09-17 17:01:07,947 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK] 2023-09-17 17:01:07,947 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK] 2023-09-17 17:01:07,950 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK] 2023-09-17 17:01:07,959 INFO [RS:0;jenkins-hbase4:46223] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,46223,1694970066168/jenkins-hbase4.apache.org%2C46223%2C1694970066168.1694970067904 2023-09-17 17:01:07,959 INFO [RS:1;jenkins-hbase4:35553] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,35553,1694970066217/jenkins-hbase4.apache.org%2C35553%2C1694970066217.1694970067904 2023-09-17 17:01:07,961 DEBUG [RS:0;jenkins-hbase4:46223] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK], DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK]] 2023-09-17 17:01:07,963 DEBUG [RS:1;jenkins-hbase4:35553] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK]] 2023-09-17 17:01:08,002 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:08,004 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 17:01:08,007 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 17:01:08,022 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-17 17:01:08,023 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 17:01:08,026 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42773%2C1694970066257.meta, suffix=.meta, logDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,42773,1694970066257, archiveDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/oldWALs, maxLogs=32 2023-09-17 17:01:08,047 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK] 2023-09-17 17:01:08,047 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK] 2023-09-17 17:01:08,049 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK] 2023-09-17 17:01:08,055 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/WALs/jenkins-hbase4.apache.org,42773,1694970066257/jenkins-hbase4.apache.org%2C42773%2C1694970066257.meta.1694970068028.meta 2023-09-17 17:01:08,056 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40639,DS-2a5e18ca-ea14-4d94-84a0-ee9de748b5ed,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-ea6eb8a6-7e21-4f3e-a746-5bed61d3191b,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-84039463-baa2-4e98-b803-7d42659efa31,DISK]] 2023-09-17 17:01:08,057 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-17 17:01:08,058 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-17 17:01:08,059 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:08,060 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-17 17:01:08,062 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-17 17:01:08,064 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-17 17:01:08,081 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-17 17:01:08,081 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:08,081 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-17 17:01:08,081 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-17 17:01:08,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-17 17:01:08,087 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/info 2023-09-17 17:01:08,087 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/info 2023-09-17 17:01:08,087 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-17 17:01:08,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:08,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-17 17:01:08,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/rep_barrier 2023-09-17 17:01:08,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/rep_barrier 2023-09-17 17:01:08,091 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-17 17:01:08,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:08,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-17 17:01:08,094 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/table 2023-09-17 17:01:08,094 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/table 2023-09-17 17:01:08,095 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-17 17:01:08,096 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:08,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740 2023-09-17 17:01:08,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740 2023-09-17 17:01:08,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-17 17:01:08,109 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-17 17:01:08,111 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73785482, jitterRate=0.09948936104774475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-17 17:01:08,113 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-17 17:01:08,124 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694970067994 2023-09-17 17:01:08,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-17 17:01:08,144 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-17 17:01:08,144 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42773,1694970066257, state=OPEN 2023-09-17 17:01:08,147 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-17 17:01:08,147 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-17 17:01:08,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-17 17:01:08,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42773,1694970066257 in 333 msec 2023-09-17 17:01:08,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-17 17:01:08,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 543 msec 2023-09-17 17:01:08,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 790 msec 2023-09-17 17:01:08,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694970068164, completionTime=-1 2023-09-17 17:01:08,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-17 17:01:08,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-17 17:01:08,236 DEBUG [hconnection-0x62e3c99e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:08,240 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:08,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-17 17:01:08,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694970128298 2023-09-17 17:01:08,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694970188298 2023-09-17 17:01:08,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 134 msec 2023-09-17 17:01:08,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36669,1694970064919-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:08,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36669,1694970064919-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:08,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36669,1694970064919-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:08,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36669, period=300000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:08,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-17 17:01:08,333 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-17 17:01:08,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-17 17:01:08,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-17 17:01:08,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-17 17:01:08,353 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:01:08,356 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:01:08,378 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,381 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d empty. 2023-09-17 17:01:08,382 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,382 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-17 17:01:08,425 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-17 17:01:08,427 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc55925ee55e1bfc7af2c533e3eb221d, NAME => 'hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:01:08,445 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:08,446 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing cc55925ee55e1bfc7af2c533e3eb221d, disabling compactions & flushes 2023-09-17 17:01:08,446 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:01:08,446 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:01:08,446 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. after waiting 0 ms 2023-09-17 17:01:08,446 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:01:08,446 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:01:08,446 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for cc55925ee55e1bfc7af2c533e3eb221d: 2023-09-17 17:01:08,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:01:08,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694970068453"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970068453"}]},"ts":"1694970068453"} 2023-09-17 17:01:08,500 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-17 17:01:08,503 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:01:08,507 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970068503"}]},"ts":"1694970068503"} 2023-09-17 17:01:08,512 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-17 17:01:08,517 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:01:08,518 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:01:08,518 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:01:08,519 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:01:08,519 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:01:08,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cc55925ee55e1bfc7af2c533e3eb221d, ASSIGN}] 2023-09-17 17:01:08,525 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cc55925ee55e1bfc7af2c533e3eb221d, ASSIGN 2023-09-17 17:01:08,527 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cc55925ee55e1bfc7af2c533e3eb221d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:01:08,680 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-17 17:01:08,682 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cc55925ee55e1bfc7af2c533e3eb221d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:08,682 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694970068681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970068681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970068681"}]},"ts":"1694970068681"} 2023-09-17 17:01:08,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cc55925ee55e1bfc7af2c533e3eb221d, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:01:08,848 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:01:08,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc55925ee55e1bfc7af2c533e3eb221d, NAME => 'hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d.', STARTKEY => '', ENDKEY => ''} 2023-09-17 17:01:08,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. service=AccessControlService 2023-09-17 17:01:08,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:08,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:08,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,854 INFO [StoreOpener-cc55925ee55e1bfc7af2c533e3eb221d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,856 DEBUG [StoreOpener-cc55925ee55e1bfc7af2c533e3eb221d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d/info 2023-09-17 17:01:08,856 DEBUG [StoreOpener-cc55925ee55e1bfc7af2c533e3eb221d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d/info 2023-09-17 17:01:08,856 INFO [StoreOpener-cc55925ee55e1bfc7af2c533e3eb221d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc55925ee55e1bfc7af2c533e3eb221d columnFamilyName info 2023-09-17 17:01:08,857 INFO [StoreOpener-cc55925ee55e1bfc7af2c533e3eb221d-1] regionserver.HStore(310): Store=cc55925ee55e1bfc7af2c533e3eb221d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:08,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:01:08,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:08,868 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc55925ee55e1bfc7af2c533e3eb221d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70226113, jitterRate=0.04645062983036041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:08,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc55925ee55e1bfc7af2c533e3eb221d: 2023-09-17 17:01:08,870 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d., pid=6, masterSystemTime=1694970068842 2023-09-17 17:01:08,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:01:08,873 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:01:08,875 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cc55925ee55e1bfc7af2c533e3eb221d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:08,875 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694970068874"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970068874"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970068874"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970068874"}]},"ts":"1694970068874"} 2023-09-17 17:01:08,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-17 17:01:08,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cc55925ee55e1bfc7af2c533e3eb221d, server=jenkins-hbase4.apache.org,42773,1694970066257 in 191 msec 2023-09-17 17:01:08,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-17 17:01:08,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cc55925ee55e1bfc7af2c533e3eb221d, ASSIGN in 359 msec 2023-09-17 17:01:08,887 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:01:08,887 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970068887"}]},"ts":"1694970068887"} 2023-09-17 17:01:08,889 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-17 17:01:08,893 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:01:08,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 551 msec 2023-09-17 17:01:08,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-17 17:01:08,955 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-17 17:01:08,955 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:08,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-17 17:01:09,002 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-17 17:01:09,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 27 msec 2023-09-17 17:01:09,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-17 17:01:09,033 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-17 17:01:09,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-17 17:01:09,047 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-17 17:01:09,052 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-17 17:01:09,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.732sec 2023-09-17 17:01:09,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-17 17:01:09,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-17 17:01:09,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-17 17:01:09,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36669,1694970064919-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-17 17:01:09,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36669,1694970064919-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-17 17:01:09,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-17 17:01:09,090 DEBUG [Listener at localhost/37077] zookeeper.ReadOnlyZKClient(139): Connect 0x0cba4ac7 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:09,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-17 17:01:09,096 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:01:09,096 DEBUG [Listener at localhost/37077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6315ad62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:09,097 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:01:09,101 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-17 17:01:09,103 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce empty. 2023-09-17 17:01:09,106 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,106 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-17 17:01:09,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-17 17:01:09,117 DEBUG [hconnection-0x233759f6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:09,136 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:09,137 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-17 17:01:09,139 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8f4cb51102119deb8a61e23c5d530fce, NAME => 'hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:01:09,139 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:01:09,139 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-17 17:01:09,140 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/test.cache.data in system properties and HBase conf 2023-09-17 17:01:09,140 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop.tmp.dir in system properties and HBase conf 2023-09-17 17:01:09,140 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop.log.dir in system properties and HBase conf 2023-09-17 17:01:09,140 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-17 17:01:09,140 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-17 17:01:09,140 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-17 17:01:09,140 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-17 17:01:09,141 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/nfs.dump.dir in system properties and HBase conf 2023-09-17 17:01:09,142 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir in system properties and HBase conf 2023-09-17 17:01:09,142 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-17 17:01:09,142 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-17 17:01:09,142 INFO [Listener at localhost/37077] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-17 17:01:09,171 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:09,171 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 8f4cb51102119deb8a61e23c5d530fce, disabling compactions & flushes 2023-09-17 17:01:09,172 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:01:09,172 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:01:09,172 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. after waiting 0 ms 2023-09-17 17:01:09,172 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:01:09,172 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:01:09,172 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 8f4cb51102119deb8a61e23c5d530fce: 2023-09-17 17:01:09,176 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:01:09,177 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694970069177"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970069177"}]},"ts":"1694970069177"} 2023-09-17 17:01:09,180 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-17 17:01:09,183 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:01:09,183 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970069183"}]},"ts":"1694970069183"} 2023-09-17 17:01:09,186 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-17 17:01:09,195 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:01:09,199 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:01:09,199 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:01:09,200 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:01:09,200 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:01:09,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8f4cb51102119deb8a61e23c5d530fce, ASSIGN}] 2023-09-17 17:01:09,203 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8f4cb51102119deb8a61e23c5d530fce, ASSIGN 2023-09-17 17:01:09,206 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=8f4cb51102119deb8a61e23c5d530fce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:01:09,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-17 17:01:09,356 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-17 17:01:09,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8f4cb51102119deb8a61e23c5d530fce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:09,357 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694970069357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970069357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970069357"}]},"ts":"1694970069357"} 2023-09-17 17:01:09,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8f4cb51102119deb8a61e23c5d530fce, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:01:09,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-17 17:01:09,521 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:01:09,521 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8f4cb51102119deb8a61e23c5d530fce, NAME => 'hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce.', STARTKEY => '', ENDKEY => ''} 2023-09-17 17:01:09,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. service=AccessControlService 2023-09-17 17:01:09,522 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:09,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:09,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,524 INFO [StoreOpener-8f4cb51102119deb8a61e23c5d530fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,526 DEBUG [StoreOpener-8f4cb51102119deb8a61e23c5d530fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce/l 2023-09-17 17:01:09,527 DEBUG [StoreOpener-8f4cb51102119deb8a61e23c5d530fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce/l 2023-09-17 17:01:09,527 INFO [StoreOpener-8f4cb51102119deb8a61e23c5d530fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f4cb51102119deb8a61e23c5d530fce columnFamilyName l 2023-09-17 17:01:09,528 INFO [StoreOpener-8f4cb51102119deb8a61e23c5d530fce-1] regionserver.HStore(310): Store=8f4cb51102119deb8a61e23c5d530fce/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:09,530 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:01:09,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:09,542 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8f4cb51102119deb8a61e23c5d530fce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62328958, jitterRate=-0.07122614979743958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:09,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8f4cb51102119deb8a61e23c5d530fce: 2023-09-17 17:01:09,544 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce., pid=11, masterSystemTime=1694970069515 2023-09-17 17:01:09,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:01:09,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:01:09,549 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8f4cb51102119deb8a61e23c5d530fce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:09,549 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694970069548"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970069548"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970069548"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970069548"}]},"ts":"1694970069548"} 2023-09-17 17:01:09,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-17 17:01:09,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8f4cb51102119deb8a61e23c5d530fce, server=jenkins-hbase4.apache.org,42773,1694970066257 in 191 msec 2023-09-17 17:01:09,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-17 17:01:09,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=8f4cb51102119deb8a61e23c5d530fce, ASSIGN in 357 msec 2023-09-17 17:01:09,562 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:01:09,563 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970069562"}]},"ts":"1694970069562"} 2023-09-17 17:01:09,565 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-17 17:01:09,568 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:01:09,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 477 msec 2023-09-17 17:01:09,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-17 17:01:09,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-17 17:01:09,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-17 17:01:10,325 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 17:01:10,671 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 17:01:10,678 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43537_jobhistory____.j2xvbx/webapp 2023-09-17 17:01:10,844 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-17 17:01:10,844 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-17 17:01:10,844 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-17 17:01:10,847 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-17 17:01:10,957 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:11,292 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:11,614 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-17 17:01:11,651 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43537 2023-09-17 17:01:11,819 WARN [Listener at jenkins-hbase4.apache.org/33739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 17:01:12,087 WARN [Listener at jenkins-hbase4.apache.org/33739] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-17 17:01:12,088 INFO [Listener at jenkins-hbase4.apache.org/33739] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 17:01:12,095 INFO [Listener at jenkins-hbase4.apache.org/33739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34091_cluster____xh8t8d/webapp 2023-09-17 17:01:12,166 INFO [Listener at jenkins-hbase4.apache.org/33739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-17 17:01:12,166 INFO [Listener at jenkins-hbase4.apache.org/33739] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-17 17:01:12,166 INFO [Listener at jenkins-hbase4.apache.org/33739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-17 17:01:12,167 INFO [Listener at jenkins-hbase4.apache.org/33739] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-17 17:01:12,175 INFO [Listener at jenkins-hbase4.apache.org/33739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:12,361 INFO [Listener at jenkins-hbase4.apache.org/33739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:12,442 INFO [Listener at jenkins-hbase4.apache.org/33739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:12,448 INFO [Listener at jenkins-hbase4.apache.org/33739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34091 2023-09-17 17:01:12,902 WARN [Listener at jenkins-hbase4.apache.org/38849] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 17:01:12,928 WARN [Listener at jenkins-hbase4.apache.org/38849] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-17 17:01:12,929 INFO [Listener at jenkins-hbase4.apache.org/38849] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 17:01:12,938 INFO [Listener at jenkins-hbase4.apache.org/38849] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43567_node____v2iwwl/webapp 2023-09-17 17:01:12,998 INFO [Listener at jenkins-hbase4.apache.org/38849] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-17 17:01:12,998 INFO [Listener at jenkins-hbase4.apache.org/38849] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-17 17:01:12,998 INFO [Listener at jenkins-hbase4.apache.org/38849] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-17 17:01:12,998 INFO [Listener at jenkins-hbase4.apache.org/38849] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-17 17:01:13,006 INFO [Listener at jenkins-hbase4.apache.org/38849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:13,027 INFO [Listener at jenkins-hbase4.apache.org/38849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:13,166 INFO [Listener at jenkins-hbase4.apache.org/38849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:13,180 INFO [Listener at jenkins-hbase4.apache.org/38849] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43567 2023-09-17 17:01:13,355 WARN [Listener at jenkins-hbase4.apache.org/42231] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 17:01:13,362 WARN [Listener at jenkins-hbase4.apache.org/42231] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-17 17:01:13,362 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 17:01:13,369 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45845_node____cgvk5y/webapp 2023-09-17 17:01:13,426 INFO [Listener at jenkins-hbase4.apache.org/42231] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-17 17:01:13,427 INFO [Listener at jenkins-hbase4.apache.org/42231] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-17 17:01:13,427 INFO [Listener at jenkins-hbase4.apache.org/42231] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-17 17:01:13,427 INFO [Listener at jenkins-hbase4.apache.org/42231] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-17 17:01:13,435 INFO [Listener at jenkins-hbase4.apache.org/42231] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:13,449 INFO [Listener at jenkins-hbase4.apache.org/42231] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:13,517 INFO [Listener at jenkins-hbase4.apache.org/42231] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 17:01:13,523 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45845 2023-09-17 17:01:13,551 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-17 17:01:13,553 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:01:13,613 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=701, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=165, AvailableMemoryMB=10364 2023-09-17 17:01:13,614 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=701 is superior to 500 2023-09-17 17:01:13,630 DEBUG [Listener at jenkins-hbase4.apache.org/42231] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-17 17:01:13,637 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-17 17:01:13,643 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 17:01:13,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 17:01:13,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-17 17:01:13,653 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:01:13,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-17 17:01:13,662 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:01:13,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 17:01:13,672 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:13,672 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:13,682 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79 empty. 2023-09-17 17:01:13,682 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250 empty. 2023-09-17 17:01:13,685 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:13,686 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:13,686 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-17 17:01:13,742 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-17 17:01:13,748 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7c3ccac84db241342ddccbabb23f9a79, NAME => 'testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:01:13,749 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7dffce918232fe3986f8db481d5cb250, NAME => 'testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:01:13,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 17:01:13,797 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:13,797 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:13,798 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 7c3ccac84db241342ddccbabb23f9a79, disabling compactions & flushes 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 7dffce918232fe3986f8db481d5cb250, disabling compactions & flushes 2023-09-17 17:01:13,799 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:13,799 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. after waiting 0 ms 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. after waiting 0 ms 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:13,799 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:13,799 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 7c3ccac84db241342ddccbabb23f9a79: 2023-09-17 17:01:13,799 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 7dffce918232fe3986f8db481d5cb250: 2023-09-17 17:01:13,803 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:01:13,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970073805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970073805"}]},"ts":"1694970073805"} 2023-09-17 17:01:13,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970073805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970073805"}]},"ts":"1694970073805"} 2023-09-17 17:01:13,863 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 17:01:13,865 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:01:13,866 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970073865"}]},"ts":"1694970073865"} 2023-09-17 17:01:13,868 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-17 17:01:13,873 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-17 17:01:13,874 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:01:13,875 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-17 17:01:13,876 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:01:13,876 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:01:13,876 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:01:13,876 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:01:13,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7c3ccac84db241342ddccbabb23f9a79, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7dffce918232fe3986f8db481d5cb250, ASSIGN}] 2023-09-17 17:01:13,876 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-17 17:01:13,879 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7dffce918232fe3986f8db481d5cb250, ASSIGN 2023-09-17 17:01:13,880 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7c3ccac84db241342ddccbabb23f9a79, ASSIGN 2023-09-17 17:01:13,881 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7c3ccac84db241342ddccbabb23f9a79, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:01:13,881 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7dffce918232fe3986f8db481d5cb250, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46223,1694970066168; forceNewPlan=false, retain=false 2023-09-17 17:01:13,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 17:01:14,031 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 17:01:14,034 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7dffce918232fe3986f8db481d5cb250, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:14,034 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7c3ccac84db241342ddccbabb23f9a79, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:14,034 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970074034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970074034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970074034"}]},"ts":"1694970074034"} 2023-09-17 17:01:14,034 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970074034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970074034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970074034"}]},"ts":"1694970074034"} 2023-09-17 17:01:14,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 7dffce918232fe3986f8db481d5cb250, server=jenkins-hbase4.apache.org,46223,1694970066168}] 2023-09-17 17:01:14,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 7c3ccac84db241342ddccbabb23f9a79, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:01:14,191 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:14,191 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 17:01:14,196 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 17:01:14,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:14,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c3ccac84db241342ddccbabb23f9a79, NAME => 'testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 17:01:14,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. service=AccessControlService 2023-09-17 17:01:14,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:14,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:14,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:14,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:14,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:14,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:14,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7dffce918232fe3986f8db481d5cb250, NAME => 'testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 17:01:14,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. service=AccessControlService 2023-09-17 17:01:14,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:14,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:14,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:14,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:14,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:14,206 INFO [StoreOpener-7c3ccac84db241342ddccbabb23f9a79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:14,206 INFO [StoreOpener-7dffce918232fe3986f8db481d5cb250-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:14,208 DEBUG [StoreOpener-7c3ccac84db241342ddccbabb23f9a79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf 2023-09-17 17:01:14,209 DEBUG [StoreOpener-7c3ccac84db241342ddccbabb23f9a79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf 2023-09-17 17:01:14,209 DEBUG [StoreOpener-7dffce918232fe3986f8db481d5cb250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf 2023-09-17 17:01:14,209 DEBUG [StoreOpener-7dffce918232fe3986f8db481d5cb250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf 2023-09-17 17:01:14,212 INFO [StoreOpener-7c3ccac84db241342ddccbabb23f9a79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c3ccac84db241342ddccbabb23f9a79 columnFamilyName cf 2023-09-17 17:01:14,212 INFO [StoreOpener-7dffce918232fe3986f8db481d5cb250-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7dffce918232fe3986f8db481d5cb250 columnFamilyName cf 2023-09-17 17:01:14,215 INFO [StoreOpener-7c3ccac84db241342ddccbabb23f9a79-1] regionserver.HStore(310): Store=7c3ccac84db241342ddccbabb23f9a79/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:14,215 INFO [StoreOpener-7dffce918232fe3986f8db481d5cb250-1] regionserver.HStore(310): Store=7dffce918232fe3986f8db481d5cb250/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:14,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:14,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:14,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:14,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:14,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:14,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:14,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:14,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c3ccac84db241342ddccbabb23f9a79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68684391, jitterRate=0.023477181792259216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:14,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c3ccac84db241342ddccbabb23f9a79: 2023-09-17 17:01:14,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:14,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79., pid=16, masterSystemTime=1694970074191 2023-09-17 17:01:14,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7dffce918232fe3986f8db481d5cb250; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64388986, jitterRate=-0.040529340505599976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:14,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7dffce918232fe3986f8db481d5cb250: 2023-09-17 17:01:14,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250., pid=15, masterSystemTime=1694970074191 2023-09-17 17:01:14,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:14,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:14,247 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7c3ccac84db241342ddccbabb23f9a79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:14,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:14,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:14,248 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970074247"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970074247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970074247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970074247"}]},"ts":"1694970074247"} 2023-09-17 17:01:14,249 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7dffce918232fe3986f8db481d5cb250, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:14,249 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970074249"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970074249"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970074249"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970074249"}]},"ts":"1694970074249"} 2023-09-17 17:01:14,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-17 17:01:14,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 7c3ccac84db241342ddccbabb23f9a79, server=jenkins-hbase4.apache.org,42773,1694970066257 in 212 msec 2023-09-17 17:01:14,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-17 17:01:14,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 7dffce918232fe3986f8db481d5cb250, server=jenkins-hbase4.apache.org,46223,1694970066168 in 216 msec 2023-09-17 17:01:14,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7c3ccac84db241342ddccbabb23f9a79, ASSIGN in 380 msec 2023-09-17 17:01:14,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-17 17:01:14,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7dffce918232fe3986f8db481d5cb250, ASSIGN in 385 msec 2023-09-17 17:01:14,266 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:01:14,266 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970074266"}]},"ts":"1694970074266"} 2023-09-17 17:01:14,269 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-17 17:01:14,272 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:01:14,278 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-17 17:01:14,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 17:01:14,297 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-17 17:01:14,331 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:14,331 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:14,331 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:14,331 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:14,331 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:01:14,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:14,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:14,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:14,340 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:14,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 693 msec 2023-09-17 17:01:14,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 17:01:14,786 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-17 17:01:14,790 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-17 17:01:14,791 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:14,794 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:01:14,819 DEBUG [hconnection-0x233759f6-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:14,825 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:14,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 17:01:14,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970074839 (current time:1694970074839). 2023-09-17 17:01:14,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:01:14,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x297cb9e6 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:14,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31997db9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:14,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:14,857 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:14,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x297cb9e6 to 127.0.0.1:59728 2023-09-17 17:01:14,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:14,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x0098f186 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:14,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b08f85d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:14,872 DEBUG [hconnection-0x504d695-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:14,875 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:14,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0098f186 to 127.0.0.1:59728 2023-09-17 17:01:14,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:14,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-17 17:01:14,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:01:14,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 17:01:14,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 17:01:14,926 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 17:01:14,927 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694970674927 2023-09-17 17:01:14,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 17:01:14,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-17 17:01:14,931 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 17:01:14,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 17:01:14,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-17 17:01:14,934 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 17:01:14,936 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694970674936 2023-09-17 17:01:14,936 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:01:14,936 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:01:14,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:14,968 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-17 17:01:14,969 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:14,969 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-17 17:01:14,969 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-17 17:01:14,970 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:14,970 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,037 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:15,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 17:01:15,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:15,042 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:01:15,091 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:15,091 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:15,091 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:15,091 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:15,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:15,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:15,092 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,092 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,092 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,092 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:01:15,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-17 17:01:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-17 17:01:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 17:01:15,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 17:01:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-17 17:01:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,095 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 17:01:15,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 17:01:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 17:01:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 17:01:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:15,099 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 17:01:15,100 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 17:01:15,100 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-17 17:01:15,100 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-17 17:01:15,100 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-17 17:01:15,098 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:15,100 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-17 17:01:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 17:01:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-17 17:01:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-17 17:01:15,103 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,104 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,104 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,104 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:15,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:15,104 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,104 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,104 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,105 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:15,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:15,105 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:15,105 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,105 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:15,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:15,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:15,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-17 17:01:15,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d62ed4c[Count = 1] remaining members to acquire global barrier 2023-09-17 17:01:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:15,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-17 17:01:15,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d62ed4c[Count = 0] remaining members to acquire global barrier 2023-09-17 17:01:15,111 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-17 17:01:15,111 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,113 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,113 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,113 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,113 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 17:01:15,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,114 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,114 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 17:01:15,114 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 17:01:15,114 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-17 17:01:15,114 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:01:15,114 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,114 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:01:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:15,115 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:15,115 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:15,115 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. started... 2023-09-17 17:01:15,115 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. started... 2023-09-17 17:01:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 17:01:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-17 17:01:15,120 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7dffce918232fe3986f8db481d5cb250: 2023-09-17 17:01:15,120 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c3ccac84db241342ddccbabb23f9a79: 2023-09-17 17:01:15,121 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,121 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,127 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:15,127 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:15,130 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:01:15,130 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:01:15,146 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:01:15,146 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-17 17:01:15,147 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:01:15,147 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-17 17:01:15,147 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-17 17:01:15,147 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-17 17:01:15,147 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:01:15,147 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-17 17:01:15,147 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-17 17:01:15,147 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-17 17:01:15,176 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. completed. 2023-09-17 17:01:15,176 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:15,177 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:15,177 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:15,177 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,177 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-17 17:01:15,177 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:01:15,180 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,180 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 17:01:15,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,180 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:15,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:15,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:15,180 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-17 17:01:15,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:15,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:15,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:15,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:01:15,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-17 17:01:15,242 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:15,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 17:01:15,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:15,244 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-17 17:01:15,544 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:15,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 17:01:15,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:15,546 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-17 17:01:15,575 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. completed. 2023-09-17 17:01:15,575 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:15,575 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:15,575 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:15,575 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,575 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-17 17:01:15,575 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:01:15,577 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 17:01:15,577 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,577 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:15,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:15,577 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-17 17:01:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:15,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46223,1694970066168': 2023-09-17 17:01:15,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-17 17:01:15,582 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-17 17:01:15,583 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:01:15,583 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:01:15,583 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,583 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:01:15,585 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,585 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:15,586 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:15,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:15,586 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:15,586 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:15,587 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:15,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:15,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:15,587 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,588 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:15,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:15,590 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,591 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,591 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,605 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,605 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:15,605 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:15,605 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:15,605 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,605 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:15,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:15,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:15,605 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:15,606 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,606 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,606 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:15,606 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,606 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:15,606 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:15,606 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,606 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:15,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:15,608 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:15,608 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:15,608 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:15,608 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:15,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:15,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:15,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-17 17:01:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:15,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:15,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:01:15,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 17:01:15,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-17 17:01:15,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,683 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:15,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694970074928Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694970075630 (+702 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694970075630Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694970075630Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694970075647 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694970075669 (+22 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694970075683 (+14 ms) 2023-09-17 17:01:15,686 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 17:01:15,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 757 msec 2023-09-17 17:01:16,046 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:16,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 17:01:16,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:01:16,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:01:16,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46223] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:01:16,069 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-17 17:01:16,069 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:16,069 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:01:16,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 17:01:16,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970076083 (current time:1694970076083). 2023-09-17 17:01:16,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:01:16,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x4d1cbef3 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:16,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41e81246, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:16,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:16,094 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:16,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d1cbef3 to 127.0.0.1:59728 2023-09-17 17:01:16,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:16,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x30eb1abb to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:16,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18a8c173, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:16,103 DEBUG [hconnection-0x19d39a02-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:16,106 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:16,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30eb1abb to 127.0.0.1:59728 2023-09-17 17:01:16,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:16,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-17 17:01:16,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:01:16,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 17:01:16,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 17:01:16,115 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 17:01:16,116 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694970676116 2023-09-17 17:01:16,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 17:01:16,116 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-17 17:01:16,117 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:01:16,117 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:01:16,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 17:01:16,118 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 17:01:16,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-09-17 17:01:16,121 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 17:01:16,122 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694970676122 2023-09-17 17:01:16,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-17 17:01:16,141 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-17 17:01:16,141 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:16,142 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-17 17:01:16,142 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-17 17:01:16,143 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,143 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,150 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:16,150 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:16,150 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:16,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:16,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:16,150 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:16,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:16,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:16,150 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:16,150 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,151 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,151 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:01:16,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-17 17:01:16,156 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 17:01:16,156 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 17:01:16,156 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:16,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 17:01:16,157 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 17:01:16,157 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-17 17:01:16,156 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:16,157 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-17 17:01:16,158 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 17:01:16,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-17 17:01:16,158 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-17 17:01:16,159 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 17:01:16,159 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-17 17:01:16,159 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:16,160 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 17:01:16,160 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-17 17:01:16,160 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-17 17:01:16,161 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,161 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:16,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:16,162 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,163 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,163 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,163 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,163 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:16,163 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,163 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:16,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:16,163 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,164 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:16,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-17 17:01:16,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67f6f6[Count = 1] remaining members to acquire global barrier 2023-09-17 17:01:16,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:16,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:16,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:16,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:16,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:16,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-17 17:01:16,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67f6f6[Count = 0] remaining members to acquire global barrier 2023-09-17 17:01:16,169 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-17 17:01:16,169 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,179 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 17:01:16,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:16,179 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 17:01:16,179 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:16,179 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,179 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:01:16,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,179 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:16,180 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:16,179 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:16,180 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 17:01:16,180 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. started... 2023-09-17 17:01:16,180 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:16,180 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-17 17:01:16,180 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. started... 2023-09-17 17:01:16,180 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:01:16,180 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7c3ccac84db241342ddccbabb23f9a79 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-17 17:01:16,180 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7dffce918232fe3986f8db481d5cb250 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-17 17:01:16,183 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 17:01:16,183 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:16,183 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-17 17:01:16,217 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:16,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 17:01:16,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:16,219 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:01:16,317 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091768ed5a4cf7ae44a3ac0a9d5fc9557e7b to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091768ed5a4cf7ae44a3ac0a9d5fc9557e7b 2023-09-17 17:01:16,317 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917b9e75aa3444e4aca8ddeae5b676ddab1 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917b9e75aa3444e4aca8ddeae5b676ddab1 2023-09-17 17:01:16,350 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/.tmp/cf/e19f46839ee24b9894e64c4d460f1f2c 2023-09-17 17:01:16,352 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/.tmp/cf/4be41a1a286448c596f63dc93e8af3bb 2023-09-17 17:01:16,361 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/.tmp/cf/4be41a1a286448c596f63dc93e8af3bb as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf/4be41a1a286448c596f63dc93e8af3bb 2023-09-17 17:01:16,362 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/.tmp/cf/e19f46839ee24b9894e64c4d460f1f2c as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf/e19f46839ee24b9894e64c4d460f1f2c 2023-09-17 17:01:16,370 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf/e19f46839ee24b9894e64c4d460f1f2c, entries=3, sequenceid=6, filesize=5.4 K 2023-09-17 17:01:16,370 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf/4be41a1a286448c596f63dc93e8af3bb, entries=47, sequenceid=6, filesize=12.8 K 2023-09-17 17:01:16,380 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7c3ccac84db241342ddccbabb23f9a79 in 200ms, sequenceid=6, compaction requested=false 2023-09-17 17:01:16,380 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-17 17:01:16,381 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c3ccac84db241342ddccbabb23f9a79: 2023-09-17 17:01:16,381 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-17 17:01:16,382 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 7dffce918232fe3986f8db481d5cb250 in 201ms, sequenceid=6, compaction requested=false 2023-09-17 17:01:16,382 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:16,383 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7dffce918232fe3986f8db481d5cb250: 2023-09-17 17:01:16,383 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf/e19f46839ee24b9894e64c4d460f1f2c] hfiles 2023-09-17 17:01:16,383 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-17 17:01:16,383 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf/e19f46839ee24b9894e64c4d460f1f2c for snapshot=snaptb0-testExportWithTargetName 2023-09-17 17:01:16,383 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:16,383 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf/4be41a1a286448c596f63dc93e8af3bb] hfiles 2023-09-17 17:01:16,383 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf/4be41a1a286448c596f63dc93e8af3bb for snapshot=snaptb0-testExportWithTargetName 2023-09-17 17:01:16,406 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. completed. 2023-09-17 17:01:16,406 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:16,406 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:16,406 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:16,406 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,406 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-17 17:01:16,406 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:01:16,410 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,410 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 17:01:16,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,410 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:16,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:16,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:16,410 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-17 17:01:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:16,415 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. completed. 2023-09-17 17:01:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,415 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:16,415 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:16,415 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:16,415 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,415 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-17 17:01:16,415 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:01:16,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,418 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,418 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 17:01:16,418 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:16,418 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-17 17:01:16,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46223,1694970066168': 2023-09-17 17:01:16,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-17 17:01:16,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:16,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:16,419 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:16,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:16,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:16,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 17:01:16,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:16,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,421 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-17 17:01:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:01:16,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-17 17:01:16,424 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-17 17:01:16,424 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:01:16,424 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:01:16,424 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-17 17:01:16,424 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:01:16,427 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,427 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,427 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,428 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:16,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,427 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:16,427 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,427 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:16,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:16,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:16,428 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:16,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,429 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:16,430 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,432 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:16,433 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 17:01:16,433 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,444 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:16,444 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:16,444 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:16,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:16,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:16,444 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:16,444 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:16,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:16,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-17 17:01:16,444 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:16,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:16,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-17 17:01:16,445 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:16,444 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:16,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-17 17:01:16,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:01:16,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:16,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:16,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:16,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:16,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:16,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:16,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091768ed5a4cf7ae44a3ac0a9d5fc9557e7b, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917b9e75aa3444e4aca8ddeae5b676ddab1] mob files 2023-09-17 17:01:16,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091768ed5a4cf7ae44a3ac0a9d5fc9557e7b 2023-09-17 17:01:16,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917b9e75aa3444e4aca8ddeae5b676ddab1 2023-09-17 17:01:16,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-17 17:01:16,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-17 17:01:16,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,509 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-17 17:01:16,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694970076116Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694970076467 (+351 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694970076467Loading Region manifests for snaptb0-testExportWithTargetName at 1694970076467Writing data manifest for snaptb0-testExportWithTargetName at 1694970076474 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694970076494 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694970076508 (+14 ms) 2023-09-17 17:01:16,511 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 17:01:16,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 395 msec 2023-09-17 17:01:16,721 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:16,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 17:01:16,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:01:16,724 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724 2023-09-17 17:01:16,725 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35449, tgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724, rawTgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724, srcFsUri=hdfs://localhost:35449, srcDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:16,766 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:16,766 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1486188880_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-17 17:01:16,766 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3, snapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-17 17:01:16,792 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-17 17:01:16,862 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:16,863 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:16,863 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:16,864 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,805 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-8216142613596079370.jar 2023-09-17 17:01:17,806 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,806 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,874 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-4158898469462300764.jar 2023-09-17 17:01:17,875 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,875 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,876 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,876 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,876 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,877 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:17,877 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 17:01:17,878 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 17:01:17,878 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 17:01:17,879 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 17:01:17,879 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 17:01:17,880 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 17:01:17,880 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 17:01:17,881 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 17:01:17,881 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 17:01:17,882 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 17:01:17,886 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:17,886 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:17,886 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:17,887 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:17,887 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:17,888 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:17,888 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:18,690 WARN [Listener at jenkins-hbase4.apache.org/42231] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 17:01:18,696 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-17 17:01:18,705 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-17 17:01:19,153 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:01:19,155 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:01:19,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0001_000001 (auth:SIMPLE) 2023-09-17 17:01:19,706 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 17:01:23,761 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0001_000001 (auth:SIMPLE) 2023-09-17 17:01:26,015 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0001_000001 (auth:SIMPLE) 2023-09-17 17:01:28,714 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0001_000001 (auth:SIMPLE) 2023-09-17 17:01:30,567 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 17:01:30,571 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 17:01:30,585 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-17 17:01:30,585 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 17:01:30,586 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 17:01:30,586 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-17 17:01:30,586 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-17 17:01:30,587 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-17 17:01:30,587 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724/.hbase-snapshot/testExportWithTargetName 2023-09-17 17:01:30,587 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-17 17:01:30,587 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970076724/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-17 17:01:30,597 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-17 17:01:30,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-17 17:01:30,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-17 17:01:30,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970090615"}]},"ts":"1694970090615"} 2023-09-17 17:01:30,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-17 17:01:30,617 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-17 17:01:30,619 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-17 17:01:30,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7c3ccac84db241342ddccbabb23f9a79, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7dffce918232fe3986f8db481d5cb250, UNASSIGN}] 2023-09-17 17:01:30,624 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7c3ccac84db241342ddccbabb23f9a79, UNASSIGN 2023-09-17 17:01:30,624 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7dffce918232fe3986f8db481d5cb250, UNASSIGN 2023-09-17 17:01:30,625 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=7c3ccac84db241342ddccbabb23f9a79, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:30,625 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=7dffce918232fe3986f8db481d5cb250, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:30,625 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970090625"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970090625"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970090625"}]},"ts":"1694970090625"} 2023-09-17 17:01:30,625 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970090625"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970090625"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970090625"}]},"ts":"1694970090625"} 2023-09-17 17:01:30,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 7dffce918232fe3986f8db481d5cb250, server=jenkins-hbase4.apache.org,46223,1694970066168}] 2023-09-17 17:01:30,628 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 7c3ccac84db241342ddccbabb23f9a79, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:01:30,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-17 17:01:30,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:30,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:30,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7dffce918232fe3986f8db481d5cb250, disabling compactions & flushes 2023-09-17 17:01:30,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c3ccac84db241342ddccbabb23f9a79, disabling compactions & flushes 2023-09-17 17:01:30,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:30,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:30,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:30,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:30,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. after waiting 0 ms 2023-09-17 17:01:30,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. after waiting 0 ms 2023-09-17 17:01:30,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:30,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:30,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:01:30,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:01:30,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:01:30,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:01:30,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79. 2023-09-17 17:01:30,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250. 2023-09-17 17:01:30,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c3ccac84db241342ddccbabb23f9a79: 2023-09-17 17:01:30,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7dffce918232fe3986f8db481d5cb250: 2023-09-17 17:01:30,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:30,809 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=7c3ccac84db241342ddccbabb23f9a79, regionState=CLOSED 2023-09-17 17:01:30,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:30,809 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970090809"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970090809"}]},"ts":"1694970090809"} 2023-09-17 17:01:30,810 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=7dffce918232fe3986f8db481d5cb250, regionState=CLOSED 2023-09-17 17:01:30,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694970090810"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970090810"}]},"ts":"1694970090810"} 2023-09-17 17:01:30,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-17 17:01:30,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 7c3ccac84db241342ddccbabb23f9a79, server=jenkins-hbase4.apache.org,42773,1694970066257 in 183 msec 2023-09-17 17:01:30,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-17 17:01:30,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 7dffce918232fe3986f8db481d5cb250, server=jenkins-hbase4.apache.org,46223,1694970066168 in 186 msec 2023-09-17 17:01:30,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7c3ccac84db241342ddccbabb23f9a79, UNASSIGN in 193 msec 2023-09-17 17:01:30,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-17 17:01:30,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7dffce918232fe3986f8db481d5cb250, UNASSIGN in 201 msec 2023-09-17 17:01:30,827 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970090827"}]},"ts":"1694970090827"} 2023-09-17 17:01:30,830 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-17 17:01:30,832 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-17 17:01:30,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 228 msec 2023-09-17 17:01:30,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-17 17:01:30,919 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-17 17:01:30,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-17 17:01:30,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 17:01:30,934 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 17:01:30,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-17 17:01:30,936 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 17:01:30,939 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-17 17:01:30,942 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:30,942 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:30,946 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/recovered.edits] 2023-09-17 17:01:30,946 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/recovered.edits] 2023-09-17 17:01:30,947 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 17:01:30,948 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 17:01:30,948 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 17:01:30,947 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 17:01:30,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-17 17:01:30,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-17 17:01:30,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-17 17:01:30,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-17 17:01:30,950 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 17:01:30,950 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 17:01:30,950 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:30,950 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 17:01:30,950 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 17:01:30,950 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:30,950 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:30,950 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:30,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-17 17:01:30,955 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf/e19f46839ee24b9894e64c4d460f1f2c to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/cf/e19f46839ee24b9894e64c4d460f1f2c 2023-09-17 17:01:30,955 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf/4be41a1a286448c596f63dc93e8af3bb to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/cf/4be41a1a286448c596f63dc93e8af3bb 2023-09-17 17:01:30,959 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79/recovered.edits/9.seqid 2023-09-17 17:01:30,959 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250/recovered.edits/9.seqid 2023-09-17 17:01:30,960 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7c3ccac84db241342ddccbabb23f9a79 2023-09-17 17:01:30,960 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportWithTargetName/7dffce918232fe3986f8db481d5cb250 2023-09-17 17:01:30,960 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-17 17:01:30,961 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-17 17:01:30,962 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-17 17:01:30,966 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091768ed5a4cf7ae44a3ac0a9d5fc9557e7b to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091768ed5a4cf7ae44a3ac0a9d5fc9557e7b 2023-09-17 17:01:30,967 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917b9e75aa3444e4aca8ddeae5b676ddab1 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917b9e75aa3444e4aca8ddeae5b676ddab1 2023-09-17 17:01:30,967 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-17 17:01:30,970 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 17:01:30,991 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-17 17:01:30,994 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-17 17:01:30,995 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 17:01:30,995 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-17 17:01:30,996 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970090995"}]},"ts":"9223372036854775807"} 2023-09-17 17:01:30,996 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970090995"}]},"ts":"9223372036854775807"} 2023-09-17 17:01:30,998 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 17:01:30,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7c3ccac84db241342ddccbabb23f9a79, NAME => 'testtb-testExportWithTargetName,,1694970073645.7c3ccac84db241342ddccbabb23f9a79.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7dffce918232fe3986f8db481d5cb250, NAME => 'testtb-testExportWithTargetName,1,1694970073645.7dffce918232fe3986f8db481d5cb250.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 17:01:30,998 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-17 17:01:30,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694970090998"}]},"ts":"9223372036854775807"} 2023-09-17 17:01:31,000 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-17 17:01:31,002 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 17:01:31,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-09-17 17:01:31,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-17 17:01:31,056 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-17 17:01:31,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-17 17:01:31,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-17 17:01:31,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-17 17:01:31,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-17 17:01:31,111 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 701) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:36242 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:35184 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:40827 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:38849 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:33524 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1219491205_1 at /127.0.0.1:36212 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1219491205_1 at /127.0.0.1:35156 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:42339 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=234 (was 183) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=9591 (was 10364) 2023-09-17 17:01:31,112 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-17 17:01:31,129 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=234, ProcessCount=168, AvailableMemoryMB=9590 2023-09-17 17:01:31,130 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-17 17:01:31,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 17:01:31,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-17 17:01:31,136 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:01:31,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-17 17:01:31,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 17:01:31,139 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:01:31,145 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,145 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,145 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4 empty. 2023-09-17 17:01:31,145 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f empty. 2023-09-17 17:01:31,146 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,146 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,146 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-17 17:01:31,161 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-17 17:01:31,163 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 799387cc6dc9997db6cd83f80ee034a4, NAME => 'testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:01:31,163 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => bbe2ab50162cdebf62efea504341b26f, NAME => 'testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:01:31,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:31,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing bbe2ab50162cdebf62efea504341b26f, disabling compactions & flushes 2023-09-17 17:01:31,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:31,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:31,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. after waiting 0 ms 2023-09-17 17:01:31,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:31,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:31,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for bbe2ab50162cdebf62efea504341b26f: 2023-09-17 17:01:31,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 17:01:31,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 17:01:31,587 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:31,587 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 799387cc6dc9997db6cd83f80ee034a4, disabling compactions & flushes 2023-09-17 17:01:31,587 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:31,587 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:31,587 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. after waiting 0 ms 2023-09-17 17:01:31,587 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:31,587 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:31,587 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 799387cc6dc9997db6cd83f80ee034a4: 2023-09-17 17:01:31,590 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:01:31,591 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970091591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970091591"}]},"ts":"1694970091591"} 2023-09-17 17:01:31,591 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970091591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970091591"}]},"ts":"1694970091591"} 2023-09-17 17:01:31,593 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 17:01:31,595 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:01:31,595 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970091595"}]},"ts":"1694970091595"} 2023-09-17 17:01:31,596 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-17 17:01:31,600 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:01:31,601 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:01:31,601 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:01:31,601 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:01:31,601 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:01:31,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=799387cc6dc9997db6cd83f80ee034a4, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bbe2ab50162cdebf62efea504341b26f, ASSIGN}] 2023-09-17 17:01:31,604 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bbe2ab50162cdebf62efea504341b26f, ASSIGN 2023-09-17 17:01:31,604 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=799387cc6dc9997db6cd83f80ee034a4, ASSIGN 2023-09-17 17:01:31,605 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bbe2ab50162cdebf62efea504341b26f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35553,1694970066217; forceNewPlan=false, retain=false 2023-09-17 17:01:31,605 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=799387cc6dc9997db6cd83f80ee034a4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:01:31,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 17:01:31,756 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 17:01:31,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=bbe2ab50162cdebf62efea504341b26f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:31,758 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=799387cc6dc9997db6cd83f80ee034a4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:31,758 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970091758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970091758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970091758"}]},"ts":"1694970091758"} 2023-09-17 17:01:31,759 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970091758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970091758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970091758"}]},"ts":"1694970091758"} 2023-09-17 17:01:31,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure bbe2ab50162cdebf62efea504341b26f, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:01:31,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 799387cc6dc9997db6cd83f80ee034a4, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:01:31,914 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:31,914 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 17:01:31,918 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 17:01:31,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:31,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 799387cc6dc9997db6cd83f80ee034a4, NAME => 'testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 17:01:31,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. service=AccessControlService 2023-09-17 17:01:31,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:31,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:31,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,925 INFO [StoreOpener-799387cc6dc9997db6cd83f80ee034a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:31,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bbe2ab50162cdebf62efea504341b26f, NAME => 'testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 17:01:31,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. service=AccessControlService 2023-09-17 17:01:31,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:31,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:31,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,927 DEBUG [StoreOpener-799387cc6dc9997db6cd83f80ee034a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf 2023-09-17 17:01:31,927 DEBUG [StoreOpener-799387cc6dc9997db6cd83f80ee034a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf 2023-09-17 17:01:31,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,928 INFO [StoreOpener-799387cc6dc9997db6cd83f80ee034a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 799387cc6dc9997db6cd83f80ee034a4 columnFamilyName cf 2023-09-17 17:01:31,928 INFO [StoreOpener-bbe2ab50162cdebf62efea504341b26f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,929 INFO [StoreOpener-799387cc6dc9997db6cd83f80ee034a4-1] regionserver.HStore(310): Store=799387cc6dc9997db6cd83f80ee034a4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:31,931 DEBUG [StoreOpener-bbe2ab50162cdebf62efea504341b26f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf 2023-09-17 17:01:31,931 DEBUG [StoreOpener-bbe2ab50162cdebf62efea504341b26f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf 2023-09-17 17:01:31,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,931 INFO [StoreOpener-bbe2ab50162cdebf62efea504341b26f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bbe2ab50162cdebf62efea504341b26f columnFamilyName cf 2023-09-17 17:01:31,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,932 INFO [StoreOpener-bbe2ab50162cdebf62efea504341b26f-1] regionserver.HStore(310): Store=bbe2ab50162cdebf62efea504341b26f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:31,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:31,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:31,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:31,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 799387cc6dc9997db6cd83f80ee034a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59433485, jitterRate=-0.11437205970287323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:31,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 799387cc6dc9997db6cd83f80ee034a4: 2023-09-17 17:01:31,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4., pid=31, masterSystemTime=1694970091914 2023-09-17 17:01:31,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:31,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bbe2ab50162cdebf62efea504341b26f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67888678, jitterRate=0.011620134115219116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bbe2ab50162cdebf62efea504341b26f: 2023-09-17 17:01:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:31,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:31,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f., pid=30, masterSystemTime=1694970091914 2023-09-17 17:01:31,946 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=799387cc6dc9997db6cd83f80ee034a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:31,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970091946"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970091946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970091946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970091946"}]},"ts":"1694970091946"} 2023-09-17 17:01:31,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:31,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:31,951 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=bbe2ab50162cdebf62efea504341b26f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:31,952 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970091951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970091951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970091951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970091951"}]},"ts":"1694970091951"} 2023-09-17 17:01:31,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-17 17:01:31,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 799387cc6dc9997db6cd83f80ee034a4, server=jenkins-hbase4.apache.org,42773,1694970066257 in 190 msec 2023-09-17 17:01:31,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=799387cc6dc9997db6cd83f80ee034a4, ASSIGN in 352 msec 2023-09-17 17:01:31,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-17 17:01:31,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure bbe2ab50162cdebf62efea504341b26f, server=jenkins-hbase4.apache.org,35553,1694970066217 in 193 msec 2023-09-17 17:01:31,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-17 17:01:31,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bbe2ab50162cdebf62efea504341b26f, ASSIGN in 355 msec 2023-09-17 17:01:31,960 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:01:31,960 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970091960"}]},"ts":"1694970091960"} 2023-09-17 17:01:31,962 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-17 17:01:31,965 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:01:31,965 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-17 17:01:31,967 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 17:01:31,969 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:31,969 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:31,969 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:31,969 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:31,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:31,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:31,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:31,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:31,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 839 msec 2023-09-17 17:01:32,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 17:01:32,245 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-17 17:01:32,248 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-17 17:01:32,249 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:32,250 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:01:32,264 DEBUG [hconnection-0x233759f6-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:32,271 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:32,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:01:32,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970092275 (current time:1694970092275). 2023-09-17 17:01:32,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:01:32,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x59a3efbc to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:32,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fa7d695, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:32,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:32,287 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:32,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59a3efbc to 127.0.0.1:59728 2023-09-17 17:01:32,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:32,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x3d40d9a1 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:32,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b580fba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:32,300 DEBUG [hconnection-0x3a0a7d3a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:32,303 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:32,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d40d9a1 to 127.0.0.1:59728 2023-09-17 17:01:32,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:32,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 17:01:32,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:01:32,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:01:32,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:01:32,313 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:01:32,314 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694970692314 2023-09-17 17:01:32,314 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-17 17:01:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:01:32,315 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:01:32,316 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:01:32,317 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:01:32,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 17:01:32,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-17 17:01:32,320 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 17:01:32,321 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694970692321 2023-09-17 17:01:32,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,346 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-17 17:01:32,346 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:32,347 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-17 17:01:32,347 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-17 17:01:32,348 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,348 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,350 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,350 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,350 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,350 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,351 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,351 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,351 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,352 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,352 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 17:01:32,352 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,352 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 17:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,354 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 17:01:32,354 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 17:01:32,354 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:32,354 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:32,355 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 17:01:32,356 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 17:01:32,356 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-17 17:01:32,356 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-17 17:01:32,356 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-17 17:01:32,354 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-17 17:01:32,356 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-17 17:01:32,356 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-17 17:01:32,364 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,364 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,365 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,365 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,365 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,365 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,365 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:32,365 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:32,366 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,366 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-17 17:01:32,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c617890[Count = 1] remaining members to acquire global barrier 2023-09-17 17:01:32,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-17 17:01:32,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c617890[Count = 0] remaining members to acquire global barrier 2023-09-17 17:01:32,370 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-17 17:01:32,370 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,372 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,372 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,372 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:01:32,372 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:01:32,372 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,372 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-17 17:01:32,372 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:01:32,372 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:32,372 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:32,373 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:32,373 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,373 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. started... 2023-09-17 17:01:32,373 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:01:32,373 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 799387cc6dc9997db6cd83f80ee034a4: 2023-09-17 17:01:32,373 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,373 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:32,373 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:01:32,374 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,374 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:01:32,374 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 17:01:32,374 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:32,374 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:32,374 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:32,376 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:32,374 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-17 17:01:32,376 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. started... 2023-09-17 17:01:32,377 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbe2ab50162cdebf62efea504341b26f: 2023-09-17 17:01:32,377 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,377 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:32,377 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:01:32,402 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. completed. 2023-09-17 17:01:32,402 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-17 17:01:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:01:32,405 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. completed. 2023-09-17 17:01:32,405 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-17 17:01:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:01:32,406 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 17:01:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-17 17:01:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 17:01:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,407 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-17 17:01:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:01:32,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-17 17:01:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,416 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:01:32,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-17 17:01:32,416 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-17 17:01:32,416 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:01:32,416 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:01:32,416 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,416 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:01:32,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 17:01:32,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:32,417 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:01:32,418 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,418 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,418 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,418 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,419 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,419 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,418 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,419 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,430 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,438 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,441 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,441 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,441 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,446 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,446 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-17 17:01:32,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,446 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,446 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:32,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 17:01:32,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,447 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,448 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,448 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,448 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,448 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,448 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-17 17:01:32,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,491 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:32,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694970092314Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694970092462 (+148 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694970092462Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694970092462Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694970092467 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694970092482 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694970092490 (+8 ms) 2023-09-17 17:01:32,493 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 17:01:32,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 178 msec 2023-09-17 17:01:32,617 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:32,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 17:01:32,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:01:32,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:01:32,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35553] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:01:32,630 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-17 17:01:32,631 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:32,631 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:01:32,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:01:32,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970092645 (current time:1694970092645). 2023-09-17 17:01:32,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:01:32,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x53ee3f79 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:32,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f40089a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:32,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:32,657 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:32,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53ee3f79 to 127.0.0.1:59728 2023-09-17 17:01:32,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:32,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x43c07443 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:32,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e7c4ec9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:32,666 DEBUG [hconnection-0x762e61a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:32,669 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:32,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43c07443 to 127.0.0.1:59728 2023-09-17 17:01:32,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:32,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 17:01:32,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:01:32,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:01:32,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:01:32,679 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:01:32,680 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694970692680 2023-09-17 17:01:32,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:01:32,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-17 17:01:32,681 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:01:32,681 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:01:32,682 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:01:32,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 17:01:32,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-17 17:01:32,685 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 17:01:32,686 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694970692686 2023-09-17 17:01:32,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-17 17:01:32,701 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-17 17:01:32,701 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:32,702 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-17 17:01:32,703 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-17 17:01:32,703 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,703 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,705 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,705 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,705 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,705 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,706 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,706 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,706 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,706 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:01:32,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-17 17:01:32,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-17 17:01:32,707 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 17:01:32,738 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 17:01:32,738 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:32,738 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 17:01:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 17:01:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-17 17:01:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-17 17:01:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-17 17:01:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-17 17:01:32,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-17 17:01:32,741 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 17:01:32,741 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:32,742 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 17:01:32,742 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-17 17:01:32,742 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-17 17:01:32,746 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,746 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,747 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,747 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,747 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:32,747 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,747 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,747 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,747 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:32,747 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,748 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:32,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-17 17:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@297b2fe1[Count = 1] remaining members to acquire global barrier 2023-09-17 17:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-17 17:01:32,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@297b2fe1[Count = 0] remaining members to acquire global barrier 2023-09-17 17:01:32,752 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-17 17:01:32,752 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:01:32,753 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:01:32,753 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-17 17:01:32,753 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,753 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:01:32,753 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,754 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:01:32,754 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. started... 2023-09-17 17:01:32,754 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,754 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:01:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:32,754 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 799387cc6dc9997db6cd83f80ee034a4 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-17 17:01:32,754 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:32,754 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. started... 2023-09-17 17:01:32,754 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bbe2ab50162cdebf62efea504341b26f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-17 17:01:32,756 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 17:01:32,756 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:32,756 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-17 17:01:32,784 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:32,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 17:01:32,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:32,786 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:01:32,790 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091759d882e2c07d4eef9a9a0e352f784124 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091759d882e2c07d4eef9a9a0e352f784124 2023-09-17 17:01:32,791 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917e8aaa6da497d426695df1e5dca26f033 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917e8aaa6da497d426695df1e5dca26f033 2023-09-17 17:01:32,817 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/.tmp/cf/7ec1599a83aa4b119d9d35bc2fd18d6d 2023-09-17 17:01:32,822 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/.tmp/cf/2970279d737d45088d701b3dcfa24052 2023-09-17 17:01:32,829 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/.tmp/cf/7ec1599a83aa4b119d9d35bc2fd18d6d as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf/7ec1599a83aa4b119d9d35bc2fd18d6d 2023-09-17 17:01:32,829 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/.tmp/cf/2970279d737d45088d701b3dcfa24052 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf/2970279d737d45088d701b3dcfa24052 2023-09-17 17:01:32,835 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf/2970279d737d45088d701b3dcfa24052, entries=3, sequenceid=6, filesize=5.4 K 2023-09-17 17:01:32,836 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 799387cc6dc9997db6cd83f80ee034a4 in 82ms, sequenceid=6, compaction requested=false 2023-09-17 17:01:32,836 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-17 17:01:32,837 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 799387cc6dc9997db6cd83f80ee034a4: 2023-09-17 17:01:32,837 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-17 17:01:32,838 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:32,838 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf/2970279d737d45088d701b3dcfa24052] hfiles 2023-09-17 17:01:32,838 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf/2970279d737d45088d701b3dcfa24052 for snapshot=snaptb0-testExportFileSystemState 2023-09-17 17:01:32,839 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf/7ec1599a83aa4b119d9d35bc2fd18d6d, entries=47, sequenceid=6, filesize=12.8 K 2023-09-17 17:01:32,840 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for bbe2ab50162cdebf62efea504341b26f in 86ms, sequenceid=6, compaction requested=false 2023-09-17 17:01:32,849 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbe2ab50162cdebf62efea504341b26f: 2023-09-17 17:01:32,849 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-17 17:01:32,849 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:32,849 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf/7ec1599a83aa4b119d9d35bc2fd18d6d] hfiles 2023-09-17 17:01:32,849 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf/7ec1599a83aa4b119d9d35bc2fd18d6d for snapshot=snaptb0-testExportFileSystemState 2023-09-17 17:01:32,867 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. completed. 2023-09-17 17:01:32,867 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:32,867 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:32,867 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:32,867 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,871 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-17 17:01:32,871 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:01:32,876 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,876 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 17:01:32,876 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. completed. 2023-09-17 17:01:32,876 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:32,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,876 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-17 17:01:32,876 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:32,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,878 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:32,878 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:32,878 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,878 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-17 17:01:32,878 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:01:32,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,880 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,880 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 17:01:32,880 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:32,880 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-17 17:01:32,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:01:32,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-17 17:01:32,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:01:32,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-17 17:01:32,888 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-17 17:01:32,888 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:01:32,888 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:01:32,888 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-17 17:01:32,888 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:01:32,892 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:32,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:32,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,892 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,892 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,892 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,893 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:32,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,894 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,894 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:32,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,896 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:32,896 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 17:01:32,897 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-17 17:01:32,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-17 17:01:32,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:32,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:01:32,900 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:32,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:32,901 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:32,901 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,901 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:32,901 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:32,901 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,901 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:32,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:32,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:32,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:32,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091759d882e2c07d4eef9a9a0e352f784124, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917e8aaa6da497d426695df1e5dca26f033] mob files 2023-09-17 17:01:32,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091759d882e2c07d4eef9a9a0e352f784124 2023-09-17 17:01:32,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917e8aaa6da497d426695df1e5dca26f033 2023-09-17 17:01:32,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-17 17:01:32,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-17 17:01:32,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,950 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 17:01:32,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694970092680Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694970092918 (+238 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694970092918Loading Region manifests for snaptb0-testExportFileSystemState at 1694970092918Writing data manifest for snaptb0-testExportFileSystemState at 1694970092928 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694970092939 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694970092949 (+10 ms) 2023-09-17 17:01:32,954 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 17:01:32,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 273 msec 2023-09-17 17:01:32,986 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:32,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 17:01:32,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:01:32,988 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988 2023-09-17 17:01:32,988 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35449, tgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988, rawTgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988, srcFsUri=hdfs://localhost:35449, srcDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:33,014 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:33,014 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1560538866_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 17:01:33,014 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3, snapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-17 17:01:33,031 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 17:01:33,059 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:33,059 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:33,060 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:33,060 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:33,948 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-882243643054850042.jar 2023-09-17 17:01:33,949 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:33,949 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:34,016 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-3395895488037024159.jar 2023-09-17 17:01:34,017 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:34,017 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:34,018 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:34,018 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:34,019 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:34,019 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:34,019 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 17:01:34,020 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 17:01:34,020 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 17:01:34,020 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 17:01:34,021 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 17:01:34,021 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 17:01:34,022 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 17:01:34,022 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 17:01:34,022 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 17:01:34,023 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 17:01:34,023 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:34,024 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:34,024 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:34,025 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:34,025 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:34,026 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:34,026 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:34,481 WARN [Listener at jenkins-hbase4.apache.org/42231] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 17:01:34,484 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-17 17:01:34,486 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-17 17:01:34,909 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:01:34,909 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:01:34,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0001_000001 (auth:SIMPLE) 2023-09-17 17:01:35,554 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0002_000001 (auth:SIMPLE) 2023-09-17 17:01:36,410 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 17:01:39,614 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0002_000001 (auth:SIMPLE) 2023-09-17 17:01:41,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0002_000001 (auth:SIMPLE) 2023-09-17 17:01:45,016 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0002_000001 (auth:SIMPLE) 2023-09-17 17:01:46,694 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 17:01:46,694 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 17:01:46,703 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-17 17:01:46,703 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 17:01:46,704 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 17:01:46,704 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-17 17:01:46,705 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-17 17:01:46,705 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-17 17:01:46,705 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-17 17:01:46,705 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-17 17:01:46,705 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970092988/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-17 17:01:46,712 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-17 17:01:46,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-17 17:01:46,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-17 17:01:46,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-17 17:01:46,718 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970106718"}]},"ts":"1694970106718"} 2023-09-17 17:01:46,720 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-17 17:01:46,721 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-17 17:01:46,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=799387cc6dc9997db6cd83f80ee034a4, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bbe2ab50162cdebf62efea504341b26f, UNASSIGN}] 2023-09-17 17:01:46,724 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=799387cc6dc9997db6cd83f80ee034a4, UNASSIGN 2023-09-17 17:01:46,724 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bbe2ab50162cdebf62efea504341b26f, UNASSIGN 2023-09-17 17:01:46,725 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=799387cc6dc9997db6cd83f80ee034a4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:46,725 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970106725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970106725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970106725"}]},"ts":"1694970106725"} 2023-09-17 17:01:46,725 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bbe2ab50162cdebf62efea504341b26f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:46,725 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970106725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970106725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970106725"}]},"ts":"1694970106725"} 2023-09-17 17:01:46,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 799387cc6dc9997db6cd83f80ee034a4, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:01:46,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure bbe2ab50162cdebf62efea504341b26f, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:01:46,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-17 17:01:46,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:46,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 799387cc6dc9997db6cd83f80ee034a4, disabling compactions & flushes 2023-09-17 17:01:46,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:46,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:46,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. after waiting 0 ms 2023-09-17 17:01:46,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:46,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:46,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bbe2ab50162cdebf62efea504341b26f, disabling compactions & flushes 2023-09-17 17:01:46,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:46,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:46,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. after waiting 0 ms 2023-09-17 17:01:46,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:46,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:01:46,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:01:46,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:01:46,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4. 2023-09-17 17:01:46,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 799387cc6dc9997db6cd83f80ee034a4: 2023-09-17 17:01:46,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:01:46,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f. 2023-09-17 17:01:46,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bbe2ab50162cdebf62efea504341b26f: 2023-09-17 17:01:46,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:46,894 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=799387cc6dc9997db6cd83f80ee034a4, regionState=CLOSED 2023-09-17 17:01:46,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:46,894 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970106894"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970106894"}]},"ts":"1694970106894"} 2023-09-17 17:01:46,894 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bbe2ab50162cdebf62efea504341b26f, regionState=CLOSED 2023-09-17 17:01:46,895 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694970106894"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970106894"}]},"ts":"1694970106894"} 2023-09-17 17:01:46,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-17 17:01:46,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 799387cc6dc9997db6cd83f80ee034a4, server=jenkins-hbase4.apache.org,42773,1694970066257 in 168 msec 2023-09-17 17:01:46,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-17 17:01:46,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure bbe2ab50162cdebf62efea504341b26f, server=jenkins-hbase4.apache.org,35553,1694970066217 in 168 msec 2023-09-17 17:01:46,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=799387cc6dc9997db6cd83f80ee034a4, UNASSIGN in 176 msec 2023-09-17 17:01:46,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-17 17:01:46,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bbe2ab50162cdebf62efea504341b26f, UNASSIGN in 176 msec 2023-09-17 17:01:46,901 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970106901"}]},"ts":"1694970106901"} 2023-09-17 17:01:46,903 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-17 17:01:46,904 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-17 17:01:46,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 192 msec 2023-09-17 17:01:47,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-17 17:01:47,020 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-17 17:01:47,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-17 17:01:47,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 17:01:47,025 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 17:01:47,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-17 17:01:47,026 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 17:01:47,027 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-17 17:01:47,031 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 17:01:47,031 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 17:01:47,031 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 17:01:47,031 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 17:01:47,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-17 17:01:47,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-17 17:01:47,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-17 17:01:47,031 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:47,031 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:47,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-17 17:01:47,032 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 17:01:47,032 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 17:01:47,032 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:47,032 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:47,032 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 17:01:47,032 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 17:01:47,033 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:47,033 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:47,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-17 17:01:47,034 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/recovered.edits] 2023-09-17 17:01:47,034 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/recovered.edits] 2023-09-17 17:01:47,039 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf/7ec1599a83aa4b119d9d35bc2fd18d6d to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/cf/7ec1599a83aa4b119d9d35bc2fd18d6d 2023-09-17 17:01:47,039 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf/2970279d737d45088d701b3dcfa24052 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/cf/2970279d737d45088d701b3dcfa24052 2023-09-17 17:01:47,042 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4/recovered.edits/9.seqid 2023-09-17 17:01:47,042 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f/recovered.edits/9.seqid 2023-09-17 17:01:47,043 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/799387cc6dc9997db6cd83f80ee034a4 2023-09-17 17:01:47,043 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemState/bbe2ab50162cdebf62efea504341b26f 2023-09-17 17:01:47,043 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-17 17:01:47,044 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-17 17:01:47,044 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-17 17:01:47,048 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091759d882e2c07d4eef9a9a0e352f784124 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091759d882e2c07d4eef9a9a0e352f784124 2023-09-17 17:01:47,049 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917e8aaa6da497d426695df1e5dca26f033 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917e8aaa6da497d426695df1e5dca26f033 2023-09-17 17:01:47,050 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-17 17:01:47,052 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 17:01:47,055 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-17 17:01:47,062 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-17 17:01:47,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 17:01:47,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-17 17:01:47,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970107063"}]},"ts":"9223372036854775807"} 2023-09-17 17:01:47,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970107063"}]},"ts":"9223372036854775807"} 2023-09-17 17:01:47,066 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 17:01:47,066 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 799387cc6dc9997db6cd83f80ee034a4, NAME => 'testtb-testExportFileSystemState,,1694970091131.799387cc6dc9997db6cd83f80ee034a4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bbe2ab50162cdebf62efea504341b26f, NAME => 'testtb-testExportFileSystemState,1,1694970091131.bbe2ab50162cdebf62efea504341b26f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 17:01:47,066 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-17 17:01:47,066 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694970107066"}]},"ts":"9223372036854775807"} 2023-09-17 17:01:47,070 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-17 17:01:47,072 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 17:01:47,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 51 msec 2023-09-17 17:01:47,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-17 17:01:47,135 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-17 17:01:47,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-17 17:01:47,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-17 17:01:47,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-17 17:01:47,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-17 17:01:47,176 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:34133 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:39016 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:42231 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_320175382_1 at /127.0.0.1:51364 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:42486 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1560538866_17 at /127.0.0.1:56560 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 234), ProcessCount=168 (was 168), AvailableMemoryMB=9436 (was 9590) 2023-09-17 17:01:47,176 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-17 17:01:47,196 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=9435 2023-09-17 17:01:47,196 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-17 17:01:47,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 17:01:47,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-17 17:01:47,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:01:47,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-17 17:01:47,203 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:01:47,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-17 17:01:47,206 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,206 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,207 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1 empty. 2023-09-17 17:01:47,207 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2 empty. 2023-09-17 17:01:47,207 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,207 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,207 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-17 17:01:47,219 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-17 17:01:47,220 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 50cc04620793b1e681971a6ae10abfb2, NAME => 'testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:01:47,220 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => fea099f7900701282c7da3f325479cb1, NAME => 'testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing fea099f7900701282c7da3f325479cb1, disabling compactions & flushes 2023-09-17 17:01:47,239 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. after waiting 0 ms 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,239 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for fea099f7900701282c7da3f325479cb1: 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 50cc04620793b1e681971a6ae10abfb2, disabling compactions & flushes 2023-09-17 17:01:47,239 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. after waiting 0 ms 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,239 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,239 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 50cc04620793b1e681971a6ae10abfb2: 2023-09-17 17:01:47,242 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:01:47,243 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970107243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970107243"}]},"ts":"1694970107243"} 2023-09-17 17:01:47,243 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970107243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970107243"}]},"ts":"1694970107243"} 2023-09-17 17:01:47,245 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 17:01:47,246 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:01:47,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970107247"}]},"ts":"1694970107247"} 2023-09-17 17:01:47,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-17 17:01:47,252 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:01:47,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:01:47,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:01:47,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:01:47,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:01:47,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fea099f7900701282c7da3f325479cb1, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50cc04620793b1e681971a6ae10abfb2, ASSIGN}] 2023-09-17 17:01:47,256 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fea099f7900701282c7da3f325479cb1, ASSIGN 2023-09-17 17:01:47,256 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50cc04620793b1e681971a6ae10abfb2, ASSIGN 2023-09-17 17:01:47,257 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50cc04620793b1e681971a6ae10abfb2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35553,1694970066217; forceNewPlan=false, retain=false 2023-09-17 17:01:47,257 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fea099f7900701282c7da3f325479cb1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46223,1694970066168; forceNewPlan=false, retain=false 2023-09-17 17:01:47,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-17 17:01:47,407 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 17:01:47,410 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=fea099f7900701282c7da3f325479cb1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,410 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=50cc04620793b1e681971a6ae10abfb2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,410 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970107410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970107410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970107410"}]},"ts":"1694970107410"} 2023-09-17 17:01:47,410 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970107410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970107410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970107410"}]},"ts":"1694970107410"} 2023-09-17 17:01:47,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure fea099f7900701282c7da3f325479cb1, server=jenkins-hbase4.apache.org,46223,1694970066168}] 2023-09-17 17:01:47,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 50cc04620793b1e681971a6ae10abfb2, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:01:47,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-17 17:01:47,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fea099f7900701282c7da3f325479cb1, NAME => 'testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 17:01:47,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50cc04620793b1e681971a6ae10abfb2, NAME => 'testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 17:01:47,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. service=AccessControlService 2023-09-17 17:01:47,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. service=AccessControlService 2023-09-17 17:01:47,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:47,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:01:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:01:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,570 INFO [StoreOpener-fea099f7900701282c7da3f325479cb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,570 INFO [StoreOpener-50cc04620793b1e681971a6ae10abfb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,571 DEBUG [StoreOpener-fea099f7900701282c7da3f325479cb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf 2023-09-17 17:01:47,572 DEBUG [StoreOpener-fea099f7900701282c7da3f325479cb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf 2023-09-17 17:01:47,572 DEBUG [StoreOpener-50cc04620793b1e681971a6ae10abfb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf 2023-09-17 17:01:47,572 DEBUG [StoreOpener-50cc04620793b1e681971a6ae10abfb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf 2023-09-17 17:01:47,572 INFO [StoreOpener-fea099f7900701282c7da3f325479cb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fea099f7900701282c7da3f325479cb1 columnFamilyName cf 2023-09-17 17:01:47,572 INFO [StoreOpener-50cc04620793b1e681971a6ae10abfb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50cc04620793b1e681971a6ae10abfb2 columnFamilyName cf 2023-09-17 17:01:47,573 INFO [StoreOpener-fea099f7900701282c7da3f325479cb1-1] regionserver.HStore(310): Store=fea099f7900701282c7da3f325479cb1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:47,574 INFO [StoreOpener-50cc04620793b1e681971a6ae10abfb2-1] regionserver.HStore(310): Store=50cc04620793b1e681971a6ae10abfb2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:01:47,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fea099f7900701282c7da3f325479cb1 2023-09-17 17:01:47,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:01:47,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:47,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:01:47,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fea099f7900701282c7da3f325479cb1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69376166, jitterRate=0.03378543257713318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:47,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fea099f7900701282c7da3f325479cb1: 2023-09-17 17:01:47,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 50cc04620793b1e681971a6ae10abfb2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66489697, jitterRate=-0.009226307272911072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:01:47,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 50cc04620793b1e681971a6ae10abfb2: 2023-09-17 17:01:47,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1., pid=45, masterSystemTime=1694970107564 2023-09-17 17:01:47,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2., pid=46, masterSystemTime=1694970107565 2023-09-17 17:01:47,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,584 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=50cc04620793b1e681971a6ae10abfb2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,584 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970107584"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970107584"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970107584"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970107584"}]},"ts":"1694970107584"} 2023-09-17 17:01:47,584 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=fea099f7900701282c7da3f325479cb1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,585 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970107584"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970107584"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970107584"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970107584"}]},"ts":"1694970107584"} 2023-09-17 17:01:47,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-17 17:01:47,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 50cc04620793b1e681971a6ae10abfb2, server=jenkins-hbase4.apache.org,35553,1694970066217 in 173 msec 2023-09-17 17:01:47,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-17 17:01:47,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure fea099f7900701282c7da3f325479cb1, server=jenkins-hbase4.apache.org,46223,1694970066168 in 175 msec 2023-09-17 17:01:47,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50cc04620793b1e681971a6ae10abfb2, ASSIGN in 335 msec 2023-09-17 17:01:47,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-17 17:01:47,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fea099f7900701282c7da3f325479cb1, ASSIGN in 336 msec 2023-09-17 17:01:47,592 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:01:47,592 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970107592"}]},"ts":"1694970107592"} 2023-09-17 17:01:47,593 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-17 17:01:47,596 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:01:47,596 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-17 17:01:47,598 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-17 17:01:47,599 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:47,599 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:47,599 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:47,599 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:01:47,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:47,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:47,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:47,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-17 17:01:47,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 403 msec 2023-09-17 17:01:47,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-17 17:01:47,807 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-17 17:01:47,809 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-17 17:01:47,809 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,812 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:01:47,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 17:01:47,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970107825 (current time:1694970107825). 2023-09-17 17:01:47,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:01:47,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x3440b317 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:47,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@737aca14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:47,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:47,836 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:47,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3440b317 to 127.0.0.1:59728 2023-09-17 17:01:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:47,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x725af573 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:47,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43332824, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:47,847 DEBUG [hconnection-0x66bc703c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:47,848 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:47,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x725af573 to 127.0.0.1:59728 2023-09-17 17:01:47,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:47,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-17 17:01:47,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:01:47,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 17:01:47,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 17:01:47,857 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 17:01:47,858 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694970707858 2023-09-17 17:01:47,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 17:01:47,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-17 17:01:47,859 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:01:47,859 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:01:47,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 17:01:47,860 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 17:01:47,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-17 17:01:47,862 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 17:01:47,863 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694970707863 2023-09-17 17:01:47,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,876 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-17 17:01:47,876 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:47,877 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-17 17:01:47,877 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-17 17:01:47,877 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,877 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,878 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,878 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:47,878 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:47,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:47,878 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:47,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:47,879 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:47,879 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,879 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,879 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 17:01:47,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 17:01:47,881 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:47,881 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 17:01:47,882 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 17:01:47,882 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-17 17:01:47,882 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,882 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-17 17:01:47,882 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 17:01:47,882 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:47,882 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:47,883 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 17:01:47,886 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-17 17:01:47,886 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 17:01:47,886 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-17 17:01:47,886 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-17 17:01:47,886 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-17 17:01:47,887 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,888 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,888 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,888 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,888 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:47,888 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:47,888 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,889 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,889 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:47,889 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:47,889 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:47,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-17 17:01:47,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4399bf0f[Count = 1] remaining members to acquire global barrier 2023-09-17 17:01:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:47,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-17 17:01:47,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4399bf0f[Count = 0] remaining members to acquire global barrier 2023-09-17 17:01:47,893 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-17 17:01:47,893 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,895 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,895 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,895 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,896 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,896 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 17:01:47,896 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 17:01:47,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,896 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-17 17:01:47,896 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 17:01:47,896 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:01:47,896 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,896 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:01:47,896 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,896 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:47,896 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,896 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. started... 2023-09-17 17:01:47,896 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. started... 2023-09-17 17:01:47,896 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:47,896 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:47,897 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:47,897 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fea099f7900701282c7da3f325479cb1: 2023-09-17 17:01:47,898 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50cc04620793b1e681971a6ae10abfb2: 2023-09-17 17:01:47,898 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,898 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:47,898 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:01:47,898 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,899 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:47,899 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:01:47,902 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 17:01:47,902 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:47,902 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-17 17:01:47,919 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. completed. 2023-09-17 17:01:47,919 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-17 17:01:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:01:47,921 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 17:01:47,921 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,921 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:47,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:47,921 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-17 17:01:47,923 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. completed. 2023-09-17 17:01:47,923 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-17 17:01:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:01:47,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:47,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:47,924 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,925 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 17:01:47,925 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:47,925 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-17 17:01:47,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46223,1694970066168': 2023-09-17 17:01:47,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-17 17:01:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:47,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:47,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:47,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:01:47,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-17 17:01:47,932 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-17 17:01:47,932 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:01:47,932 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:01:47,932 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,932 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:01:47,934 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:47,934 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:47,934 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:47,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:47,934 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:47,934 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:47,935 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:47,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,936 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:47,938 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,939 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,939 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:47,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:47,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:47,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:47,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-17 17:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:47,943 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:47,944 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,943 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:47,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:01:47,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:47,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:47,944 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:47,945 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:47,945 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:47,945 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:47,945 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:47,945 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,945 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 17:01:47,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,959 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:47,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-17 17:01:47,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:47,961 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:01:47,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-17 17:01:47,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,974 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-17 17:01:47,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694970107858Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694970107953 (+95 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694970107953Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694970107953Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694970107957 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694970107967 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694970107974 (+7 ms) 2023-09-17 17:01:47,977 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 17:01:47,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 118 msec 2023-09-17 17:01:48,161 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:48,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-17 17:01:48,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:01:48,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46223] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:01:48,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35553] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:01:48,170 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-17 17:01:48,170 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:48,170 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:01:48,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 17:01:48,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970108182 (current time:1694970108182). 2023-09-17 17:01:48,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:01:48,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x5d050d26 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:48,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@730d1865, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:48,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:48,199 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d050d26 to 127.0.0.1:59728 2023-09-17 17:01:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:48,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x5d234676 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:01:48,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a72e871, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:01:48,209 DEBUG [hconnection-0x16ed1f1b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:01:48,211 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:01:48,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d234676 to 127.0.0.1:59728 2023-09-17 17:01:48,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:01:48,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-17 17:01:48,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:01:48,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 17:01:48,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 17:01:48,222 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 17:01:48,223 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694970708223 2023-09-17 17:01:48,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 17:01:48,223 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-17 17:01:48,224 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:01:48,224 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:01:48,228 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 17:01:48,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 17:01:48,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-09-17 17:01:48,231 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 17:01:48,231 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694970708231 2023-09-17 17:01:48,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-17 17:01:48,246 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-17 17:01:48,246 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:48,248 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-17 17:01:48,248 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-17 17:01:48,248 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,248 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,250 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,250 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:48,250 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:48,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:48,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:48,250 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:48,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:48,250 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,250 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,251 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,251 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:01:48,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-17 17:01:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-17 17:01:48,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 17:01:48,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 17:01:48,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-17 17:01:48,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-17 17:01:48,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-17 17:01:48,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 17:01:48,252 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 17:01:48,252 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:48,252 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 17:01:48,252 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:48,253 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 17:01:48,254 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-17 17:01:48,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-17 17:01:48,255 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 17:01:48,255 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 17:01:48,254 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-17 17:01:48,255 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:01:48,255 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-17 17:01:48,256 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 17:01:48,256 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-17 17:01:48,256 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-17 17:01:48,256 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-17 17:01:48,257 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,257 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,257 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,258 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:01:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-17 17:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c7621cc[Count = 1] remaining members to acquire global barrier 2023-09-17 17:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:48,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-17 17:01:48,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c7621cc[Count = 0] remaining members to acquire global barrier 2023-09-17 17:01:48,262 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-17 17:01:48,262 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 17:01:48,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:48,265 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:48,265 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. started... 2023-09-17 17:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 17:01:48,265 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,265 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-17 17:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,265 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fea099f7900701282c7da3f325479cb1 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-17 17:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 17:01:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:01:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:01:48,266 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:48,266 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. started... 2023-09-17 17:01:48,266 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 50cc04620793b1e681971a6ae10abfb2 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-17 17:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 17:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-17 17:01:48,290 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230917f4e37c83aac04547bb0ea55b475285ba to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230917f4e37c83aac04547bb0ea55b475285ba 2023-09-17 17:01:48,290 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917b044bdd385db45eab05aed6089420d22 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230917b044bdd385db45eab05aed6089420d22 2023-09-17 17:01:48,306 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/.tmp/cf/4eb5df890c1f49c783cd22d230467026 2023-09-17 17:01:48,307 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/.tmp/cf/feb9c0430eaf493aa42f51dbae945032 2023-09-17 17:01:48,312 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/.tmp/cf/4eb5df890c1f49c783cd22d230467026 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf/4eb5df890c1f49c783cd22d230467026 2023-09-17 17:01:48,313 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/.tmp/cf/feb9c0430eaf493aa42f51dbae945032 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf/feb9c0430eaf493aa42f51dbae945032 2023-09-17 17:01:48,317 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf/4eb5df890c1f49c783cd22d230467026, entries=4, sequenceid=6, filesize=5.5 K 2023-09-17 17:01:48,318 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf/feb9c0430eaf493aa42f51dbae945032, entries=46, sequenceid=6, filesize=12.5 K 2023-09-17 17:01:48,319 INFO [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for fea099f7900701282c7da3f325479cb1 in 54ms, sequenceid=6, compaction requested=false 2023-09-17 17:01:48,319 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-17 17:01:48,320 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 50cc04620793b1e681971a6ae10abfb2 in 53ms, sequenceid=6, compaction requested=false 2023-09-17 17:01:48,320 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fea099f7900701282c7da3f325479cb1: 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50cc04620793b1e681971a6ae10abfb2: 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf/4eb5df890c1f49c783cd22d230467026] hfiles 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf/feb9c0430eaf493aa42f51dbae945032] hfiles 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf/feb9c0430eaf493aa42f51dbae945032 for snapshot=snaptb0-testConsecutiveExports 2023-09-17 17:01:48,321 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf/4eb5df890c1f49c783cd22d230467026 for snapshot=snaptb0-testConsecutiveExports 2023-09-17 17:01:48,325 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:48,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-17 17:01:48,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:01:48,326 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:01:48,338 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. completed. 2023-09-17 17:01:48,338 DEBUG [rs(jenkins-hbase4.apache.org,46223,1694970066168)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:01:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:48,338 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. completed. 2023-09-17 17:01:48,338 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:01:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:01:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-17 17:01:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:01:48,339 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:01:48,339 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-17 17:01:48,339 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:01:48,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,340 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 17:01:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,340 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:48,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,340 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 17:01:48,340 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-17 17:01:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:48,341 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:48,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:48,342 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-17 17:01:48,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:48,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:48,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46223,1694970066168': 2023-09-17 17:01:48,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-17 17:01:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:48,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:01:48,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-17 17:01:48,349 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-17 17:01:48,349 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:01:48,349 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:01:48,349 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-17 17:01:48,349 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:01:48,351 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:48,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:01:48,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:01:48,351 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:48,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:48,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:48,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:01:48,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,351 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:48,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,352 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:48,352 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:01:48,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,353 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:01:48,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 17:01:48,355 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,355 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,356 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,362 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:48,362 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:48,362 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:48,362 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:01:48,362 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:01:48,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:48,362 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:48,362 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-17 17:01:48,362 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:48,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-17 17:01:48,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:01:48,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:48,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-17 17:01:48,362 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:01:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:48,362 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:01:48,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:01:48,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:01:48,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:01:48,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:48,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:01:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:48,364 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:01:48,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:01:48,365 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230917f4e37c83aac04547bb0ea55b475285ba, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230917b044bdd385db45eab05aed6089420d22] mob files 2023-09-17 17:01:48,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230917f4e37c83aac04547bb0ea55b475285ba 2023-09-17 17:01:48,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230917b044bdd385db45eab05aed6089420d22 2023-09-17 17:01:48,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-17 17:01:48,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-17 17:01:48,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,392 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694970108223Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694970108374 (+151 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694970108374Loading Region manifests for snaptb0-testConsecutiveExports at 1694970108374Writing data manifest for snaptb0-testConsecutiveExports at 1694970108377 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694970108384 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694970108392 (+8 ms) 2023-09-17 17:01:48,395 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 17:01:48,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 171 msec 2023-09-17 17:01:48,526 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:01:48,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-17 17:01:48,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:01:48,528 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528 2023-09-17 17:01:48,528 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528, srcFsUri=hdfs://localhost:35449, srcDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:48,554 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:01:48,554 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5b0b1648, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,554 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3, snapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-17 17:01:48,562 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 17:01:48,573 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:48,574 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:48,574 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:48,574 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,455 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-2602184502097858713.jar 2023-09-17 17:01:49,456 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,456 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,523 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-2235969096670444758.jar 2023-09-17 17:01:49,523 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,524 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,524 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,524 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,525 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,525 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 17:01:49,525 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 17:01:49,526 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 17:01:49,526 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 17:01:49,527 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 17:01:49,527 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 17:01:49,527 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 17:01:49,528 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 17:01:49,528 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 17:01:49,528 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 17:01:49,529 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 17:01:49,529 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:49,530 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:49,530 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:49,531 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:49,531 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:01:49,531 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:49,532 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:01:49,998 WARN [Listener at jenkins-hbase4.apache.org/42231] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 17:01:50,000 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-17 17:01:50,002 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-17 17:01:51,188 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:01:51,188 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:01:51,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0002_000001 (auth:SIMPLE) 2023-09-17 17:01:52,013 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0003_000001 (auth:SIMPLE) 2023-09-17 17:01:52,466 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 17:01:55,790 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0003_000001 (auth:SIMPLE) 2023-09-17 17:01:58,005 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0003_000001 (auth:SIMPLE) 2023-09-17 17:02:00,324 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0003_000001 (auth:SIMPLE) 2023-09-17 17:02:02,160 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 17:02:02,160 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 17:02:02,165 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-17 17:02:02,165 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 17:02:02,166 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 17:02:02,166 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 17:02:02,168 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-17 17:02:02,168 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-17 17:02:02,168 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@575709c7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 17:02:02,169 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-17 17:02:02,169 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-17 17:02:02,170 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528, srcFsUri=hdfs://localhost:35449, srcDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:02:02,192 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:02:02,192 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4e56bc70, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 17:02:02,192 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3, snapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-17 17:02:02,202 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 17:02:02,214 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:02,214 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:02,214 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:02,215 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,092 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-580861879442950053.jar 2023-09-17 17:02:03,092 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,092 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,158 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-8771754021564998281.jar 2023-09-17 17:02:03,159 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,159 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,160 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,160 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,160 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,161 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:03,161 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 17:02:03,161 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 17:02:03,162 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 17:02:03,162 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 17:02:03,163 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 17:02:03,163 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 17:02:03,164 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 17:02:03,164 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 17:02:03,164 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 17:02:03,165 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 17:02:03,165 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:03,166 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:03,166 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:03,166 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:03,167 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:03,167 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:03,168 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:03,532 WARN [Listener at jenkins-hbase4.apache.org/42231] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 17:02:03,534 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-17 17:02:03,536 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-17 17:02:06,497 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:02:06,497 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:02:06,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0003_000001 (auth:SIMPLE) 2023-09-17 17:02:07,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0004_000001 (auth:SIMPLE) 2023-09-17 17:02:10,902 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0004_000001 (auth:SIMPLE) 2023-09-17 17:02:13,122 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0004_000001 (auth:SIMPLE) 2023-09-17 17:02:15,401 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0004_000001 (auth:SIMPLE) 2023-09-17 17:02:16,706 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 17:02:16,706 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 17:02:16,709 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-17 17:02:16,709 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 17:02:16,710 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 17:02:16,710 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 17:02:16,714 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-17 17:02:16,714 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-17 17:02:16,714 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@575709c7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 17:02:16,715 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-17 17:02:16,715 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/local-export-1694970108528/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-17 17:02:16,727 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-17 17:02:16,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-17 17:02:16,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-17 17:02:16,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-17 17:02:16,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970136731"}]},"ts":"1694970136731"} 2023-09-17 17:02:16,733 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-17 17:02:16,735 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-17 17:02:16,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fea099f7900701282c7da3f325479cb1, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50cc04620793b1e681971a6ae10abfb2, UNASSIGN}] 2023-09-17 17:02:16,737 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fea099f7900701282c7da3f325479cb1, UNASSIGN 2023-09-17 17:02:16,737 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50cc04620793b1e681971a6ae10abfb2, UNASSIGN 2023-09-17 17:02:16,738 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=50cc04620793b1e681971a6ae10abfb2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:16,738 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=fea099f7900701282c7da3f325479cb1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:16,738 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970136738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970136738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970136738"}]},"ts":"1694970136738"} 2023-09-17 17:02:16,738 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970136738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970136738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970136738"}]},"ts":"1694970136738"} 2023-09-17 17:02:16,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 50cc04620793b1e681971a6ae10abfb2, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:02:16,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure fea099f7900701282c7da3f325479cb1, server=jenkins-hbase4.apache.org,46223,1694970066168}] 2023-09-17 17:02:16,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-17 17:02:16,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:02:16,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 50cc04620793b1e681971a6ae10abfb2, disabling compactions & flushes 2023-09-17 17:02:16,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:02:16,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:02:16,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. after waiting 0 ms 2023-09-17 17:02:16,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:02:16,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fea099f7900701282c7da3f325479cb1 2023-09-17 17:02:16,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fea099f7900701282c7da3f325479cb1, disabling compactions & flushes 2023-09-17 17:02:16,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:02:16,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:02:16,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. after waiting 0 ms 2023-09-17 17:02:16,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:02:16,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:02:16,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:02:16,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:16,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2. 2023-09-17 17:02:16,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 50cc04620793b1e681971a6ae10abfb2: 2023-09-17 17:02:16,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:16,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1. 2023-09-17 17:02:16,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fea099f7900701282c7da3f325479cb1: 2023-09-17 17:02:16,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:02:16,908 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=50cc04620793b1e681971a6ae10abfb2, regionState=CLOSED 2023-09-17 17:02:16,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fea099f7900701282c7da3f325479cb1 2023-09-17 17:02:16,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970136908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970136908"}]},"ts":"1694970136908"} 2023-09-17 17:02:16,909 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=fea099f7900701282c7da3f325479cb1, regionState=CLOSED 2023-09-17 17:02:16,909 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694970136909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970136909"}]},"ts":"1694970136909"} 2023-09-17 17:02:16,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-17 17:02:16,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 50cc04620793b1e681971a6ae10abfb2, server=jenkins-hbase4.apache.org,35553,1694970066217 in 171 msec 2023-09-17 17:02:16,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-17 17:02:16,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure fea099f7900701282c7da3f325479cb1, server=jenkins-hbase4.apache.org,46223,1694970066168 in 171 msec 2023-09-17 17:02:16,913 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50cc04620793b1e681971a6ae10abfb2, UNASSIGN in 177 msec 2023-09-17 17:02:16,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-17 17:02:16,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fea099f7900701282c7da3f325479cb1, UNASSIGN in 177 msec 2023-09-17 17:02:16,918 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970136918"}]},"ts":"1694970136918"} 2023-09-17 17:02:16,919 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-17 17:02:16,921 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-17 17:02:16,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-09-17 17:02:17,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-17 17:02:17,033 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-17 17:02:17,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-17 17:02:17,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 17:02:17,037 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 17:02:17,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-17 17:02:17,038 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 17:02:17,041 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-17 17:02:17,045 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 17:02:17,045 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 17:02:17,045 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 17:02:17,045 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 17:02:17,045 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1 2023-09-17 17:02:17,045 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:02:17,045 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-17 17:02:17,045 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-17 17:02:17,045 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-17 17:02:17,046 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 17:02:17,046 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:17,046 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 17:02:17,046 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:17,046 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 17:02:17,046 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-17 17:02:17,047 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:17,047 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-17 17:02:17,046 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:17,047 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/recovered.edits] 2023-09-17 17:02:17,048 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/recovered.edits] 2023-09-17 17:02:17,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-17 17:02:17,053 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf/4eb5df890c1f49c783cd22d230467026 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/cf/4eb5df890c1f49c783cd22d230467026 2023-09-17 17:02:17,053 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf/feb9c0430eaf493aa42f51dbae945032 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/cf/feb9c0430eaf493aa42f51dbae945032 2023-09-17 17:02:17,056 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1/recovered.edits/9.seqid 2023-09-17 17:02:17,056 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2/recovered.edits/9.seqid 2023-09-17 17:02:17,059 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/fea099f7900701282c7da3f325479cb1 2023-09-17 17:02:17,060 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testConsecutiveExports/50cc04620793b1e681971a6ae10abfb2 2023-09-17 17:02:17,060 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-17 17:02:17,060 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-17 17:02:17,061 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-17 17:02:17,064 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230917f4e37c83aac04547bb0ea55b475285ba to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230917f4e37c83aac04547bb0ea55b475285ba 2023-09-17 17:02:17,065 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230917b044bdd385db45eab05aed6089420d22 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230917b044bdd385db45eab05aed6089420d22 2023-09-17 17:02:17,065 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-17 17:02:17,067 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 17:02:17,069 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-17 17:02:17,072 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-17 17:02:17,073 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 17:02:17,073 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-17 17:02:17,073 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970137073"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:17,073 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970137073"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:17,075 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 17:02:17,075 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fea099f7900701282c7da3f325479cb1, NAME => 'testtb-testConsecutiveExports,,1694970107197.fea099f7900701282c7da3f325479cb1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 50cc04620793b1e681971a6ae10abfb2, NAME => 'testtb-testConsecutiveExports,1,1694970107197.50cc04620793b1e681971a6ae10abfb2.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 17:02:17,075 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-17 17:02:17,075 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694970137075"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:17,076 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-17 17:02:17,078 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 17:02:17,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 44 msec 2023-09-17 17:02:17,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-17 17:02:17,150 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-17 17:02:17,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-17 17:02:17,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-17 17:02:17,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-17 17:02:17,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-17 17:02:17,187 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=752 (was 763), OpenFileDescriptor=903 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=215 (was 202) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=9283 (was 9435) 2023-09-17 17:02:17,187 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-17 17:02:17,208 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=752, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=215, ProcessCount=168, AvailableMemoryMB=9280 2023-09-17 17:02:17,208 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-17 17:02:17,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 17:02:17,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,213 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:02:17,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-17 17:02:17,214 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:02:17,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-17 17:02:17,216 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,216 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,217 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df empty. 2023-09-17 17:02:17,217 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554 empty. 2023-09-17 17:02:17,218 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,218 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,218 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-17 17:02:17,227 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-17 17:02:17,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a0e43c1688cc320a711ee97a18554554, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:02:17,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 88da8cf4b312157ee21e53b16cad60df, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:02:17,245 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:17,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a0e43c1688cc320a711ee97a18554554, disabling compactions & flushes 2023-09-17 17:02:17,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. after waiting 0 ms 2023-09-17 17:02:17,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a0e43c1688cc320a711ee97a18554554: 2023-09-17 17:02:17,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:17,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 88da8cf4b312157ee21e53b16cad60df, disabling compactions & flushes 2023-09-17 17:02:17,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. after waiting 0 ms 2023-09-17 17:02:17,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 88da8cf4b312157ee21e53b16cad60df: 2023-09-17 17:02:17,253 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:02:17,254 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970137253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970137253"}]},"ts":"1694970137253"} 2023-09-17 17:02:17,254 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970137253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970137253"}]},"ts":"1694970137253"} 2023-09-17 17:02:17,260 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 17:02:17,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:02:17,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970137261"}]},"ts":"1694970137261"} 2023-09-17 17:02:17,262 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-17 17:02:17,266 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:02:17,268 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:02:17,268 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:02:17,268 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:02:17,268 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:02:17,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88da8cf4b312157ee21e53b16cad60df, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a0e43c1688cc320a711ee97a18554554, ASSIGN}] 2023-09-17 17:02:17,270 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a0e43c1688cc320a711ee97a18554554, ASSIGN 2023-09-17 17:02:17,270 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88da8cf4b312157ee21e53b16cad60df, ASSIGN 2023-09-17 17:02:17,271 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88da8cf4b312157ee21e53b16cad60df, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:02:17,271 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a0e43c1688cc320a711ee97a18554554, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35553,1694970066217; forceNewPlan=false, retain=false 2023-09-17 17:02:17,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-17 17:02:17,421 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 17:02:17,423 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=88da8cf4b312157ee21e53b16cad60df, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,423 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a0e43c1688cc320a711ee97a18554554, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,424 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970137423"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970137423"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970137423"}]},"ts":"1694970137423"} 2023-09-17 17:02:17,424 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970137423"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970137423"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970137423"}]},"ts":"1694970137423"} 2023-09-17 17:02:17,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure a0e43c1688cc320a711ee97a18554554, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:02:17,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 88da8cf4b312157ee21e53b16cad60df, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:17,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-17 17:02:17,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88da8cf4b312157ee21e53b16cad60df, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 17:02:17,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0e43c1688cc320a711ee97a18554554, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 17:02:17,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. service=AccessControlService 2023-09-17 17:02:17,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. service=AccessControlService 2023-09-17 17:02:17,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:17,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:17,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:17,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:17,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,584 INFO [StoreOpener-88da8cf4b312157ee21e53b16cad60df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,584 INFO [StoreOpener-a0e43c1688cc320a711ee97a18554554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,586 DEBUG [StoreOpener-a0e43c1688cc320a711ee97a18554554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf 2023-09-17 17:02:17,586 DEBUG [StoreOpener-a0e43c1688cc320a711ee97a18554554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf 2023-09-17 17:02:17,586 DEBUG [StoreOpener-88da8cf4b312157ee21e53b16cad60df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf 2023-09-17 17:02:17,586 DEBUG [StoreOpener-88da8cf4b312157ee21e53b16cad60df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf 2023-09-17 17:02:17,587 INFO [StoreOpener-a0e43c1688cc320a711ee97a18554554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0e43c1688cc320a711ee97a18554554 columnFamilyName cf 2023-09-17 17:02:17,587 INFO [StoreOpener-88da8cf4b312157ee21e53b16cad60df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88da8cf4b312157ee21e53b16cad60df columnFamilyName cf 2023-09-17 17:02:17,588 INFO [StoreOpener-88da8cf4b312157ee21e53b16cad60df-1] regionserver.HStore(310): Store=88da8cf4b312157ee21e53b16cad60df/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:17,588 INFO [StoreOpener-a0e43c1688cc320a711ee97a18554554-1] regionserver.HStore(310): Store=a0e43c1688cc320a711ee97a18554554/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:17,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:17,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:17,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:02:17,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:02:17,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88da8cf4b312157ee21e53b16cad60df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74778848, jitterRate=0.11429166793823242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:17,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88da8cf4b312157ee21e53b16cad60df: 2023-09-17 17:02:17,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a0e43c1688cc320a711ee97a18554554; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71055540, jitterRate=0.05881005525588989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:17,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a0e43c1688cc320a711ee97a18554554: 2023-09-17 17:02:17,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df., pid=61, masterSystemTime=1694970137577 2023-09-17 17:02:17,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554., pid=60, masterSystemTime=1694970137577 2023-09-17 17:02:17,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,600 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=88da8cf4b312157ee21e53b16cad60df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,600 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970137600"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970137600"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970137600"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970137600"}]},"ts":"1694970137600"} 2023-09-17 17:02:17,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,601 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a0e43c1688cc320a711ee97a18554554, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,601 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970137601"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970137601"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970137601"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970137601"}]},"ts":"1694970137601"} 2023-09-17 17:02:17,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-17 17:02:17,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 88da8cf4b312157ee21e53b16cad60df, server=jenkins-hbase4.apache.org,42773,1694970066257 in 176 msec 2023-09-17 17:02:17,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-17 17:02:17,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure a0e43c1688cc320a711ee97a18554554, server=jenkins-hbase4.apache.org,35553,1694970066217 in 178 msec 2023-09-17 17:02:17,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88da8cf4b312157ee21e53b16cad60df, ASSIGN in 336 msec 2023-09-17 17:02:17,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-17 17:02:17,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a0e43c1688cc320a711ee97a18554554, ASSIGN in 337 msec 2023-09-17 17:02:17,608 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:02:17,608 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970137608"}]},"ts":"1694970137608"} 2023-09-17 17:02:17,609 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-17 17:02:17,611 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:02:17,611 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-17 17:02:17,613 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-17 17:02:17,614 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:17,614 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:17,614 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:17,614 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:17,616 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:17,616 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:17,616 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:17,616 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:17,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 406 msec 2023-09-17 17:02:17,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-17 17:02:17,818 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-17 17:02:17,820 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,820 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,822 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:02:17,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 17:02:17,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970137834 (current time:1694970137834). 2023-09-17 17:02:17,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:02:17,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x342cac5d to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:17,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5beaf344, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:17,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:17,847 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:17,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x342cac5d to 127.0.0.1:59728 2023-09-17 17:02:17,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:17,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x16fc050f to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:17,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47630dc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:17,854 DEBUG [hconnection-0x4b9fb6b2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:17,857 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:17,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16fc050f to 127.0.0.1:59728 2023-09-17 17:02:17,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:17,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-17 17:02:17,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:02:17,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 17:02:17,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 17:02:17,864 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 17:02:17,865 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694970737865 2023-09-17 17:02:17,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 17:02:17,866 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:02:17,866 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:02:17,867 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 17:02:17,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 17:02:17,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-17 17:02:17,869 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 17:02:17,869 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694970737869 2023-09-17 17:02:17,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,883 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-17 17:02:17,883 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:17,884 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-17 17:02:17,884 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-17 17:02:17,884 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,884 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,886 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:17,886 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:17,886 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:17,886 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:17,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:17,886 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,886 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,887 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,887 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 17:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-17 17:02:17,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,888 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,888 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 17:02:17,888 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 17:02:17,888 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,888 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:17,888 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 17:02:17,889 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 17:02:17,889 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 17:02:17,889 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 17:02:17,889 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:17,888 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,890 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 17:02:17,890 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 17:02:17,890 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:17,890 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 17:02:17,891 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 17:02:17,891 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 17:02:17,891 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 17:02:17,891 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 17:02:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,892 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:17,893 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,893 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,893 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:17,893 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-17 17:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bf4732a[Count = 1] remaining members to acquire global barrier 2023-09-17 17:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-17 17:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bf4732a[Count = 0] remaining members to acquire global barrier 2023-09-17 17:02:17,897 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-17 17:02:17,898 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,900 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,900 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 17:02:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 17:02:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:17,901 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:17,901 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. started... 2023-09-17 17:02:17,901 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0e43c1688cc320a711ee97a18554554: 2023-09-17 17:02:17,902 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 17:02:17,901 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. started... 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,902 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88da8cf4b312157ee21e53b16cad60df: 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:17,902 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,902 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:17,902 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:02:17,908 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 17:02:17,908 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:17,908 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 17:02:17,916 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. completed. 2023-09-17 17:02:17,916 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:17,916 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:17,916 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:17,916 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,916 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 17:02:17,916 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:02:17,917 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. completed. 2023-09-17 17:02:17,917 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 17:02:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 17:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:17,918 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,918 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 17:02:17,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:17,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:17,922 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 17:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:17,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:17,922 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 17:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:17,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:02:17,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-17 17:02:17,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:17,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:17,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:17,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:17,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:17,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:02:17,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-17 17:02:17,929 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-17 17:02:17,929 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:02:17,929 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:02:17,929 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,929 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:02:17,931 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:17,931 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,932 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:17,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,931 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:17,932 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:17,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:17,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:17,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:17,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,932 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,934 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,934 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,935 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,937 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:17,937 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:17,938 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:17,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:17,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:17,938 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:17,938 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:17,938 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:17,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:17,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:17,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,938 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:17,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,938 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:17,939 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:02:17,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:17,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,940 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 17:02:17,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:17,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,966 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:17,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-17 17:02:17,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:02:17,968 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:02:17,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,973 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-17 17:02:17,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,973 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:17,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694970137865Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694970137952 (+87 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694970137952Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694970137952Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694970137956 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694970137967 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694970137973 (+6 ms) 2023-09-17 17:02:17,976 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 17:02:17,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 110 msec 2023-09-17 17:02:18,168 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:18,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-17 17:02:18,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:02:18,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:02:18,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35553] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:02:18,176 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,176 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:18,177 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:02:18,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 17:02:18,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970138187 (current time:1694970138187). 2023-09-17 17:02:18,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:02:18,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x2b14ce5d to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:18,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e6b7f53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:18,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:18,199 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b14ce5d to 127.0.0.1:59728 2023-09-17 17:02:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:18,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x13724124 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:18,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e190331, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:18,209 DEBUG [hconnection-0x1b8d7646-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:18,210 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:18,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13724124 to 127.0.0.1:59728 2023-09-17 17:02:18,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:18,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-17 17:02:18,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:02:18,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 17:02:18,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 17:02:18,218 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 17:02:18,219 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694970738219 2023-09-17 17:02:18,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 17:02:18,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,220 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:02:18,220 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:02:18,221 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 17:02:18,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 17:02:18,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-17 17:02:18,223 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 17:02:18,224 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694970738224 2023-09-17 17:02:18,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,232 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-17 17:02:18,232 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:18,233 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-17 17:02:18,233 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-17 17:02:18,233 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,233 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,234 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:18,234 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:18,235 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:18,235 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:18,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:18,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:18,235 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:18,235 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,235 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,235 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 17:02:18,236 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 17:02:18,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 17:02:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 17:02:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:18,238 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 17:02:18,238 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 17:02:18,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-17 17:02:18,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 17:02:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 17:02:18,239 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 17:02:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 17:02:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 17:02:18,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 17:02:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:18,240 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 17:02:18,240 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 17:02:18,240 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 17:02:18,245 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,245 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,245 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:18,246 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,246 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,246 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,246 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:18,246 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,246 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:18,246 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,246 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:18,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-17 17:02:18,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b805b92[Count = 1] remaining members to acquire global barrier 2023-09-17 17:02:18,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:18,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:18,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:18,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-17 17:02:18,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b805b92[Count = 0] remaining members to acquire global barrier 2023-09-17 17:02:18,250 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-17 17:02:18,250 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 17:02:18,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,251 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 17:02:18,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,251 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:18,251 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 17:02:18,252 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. started... 2023-09-17 17:02:18,252 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,252 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:02:18,251 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:18,252 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:18,252 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:02:18,252 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a0e43c1688cc320a711ee97a18554554 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-17 17:02:18,252 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 17:02:18,252 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:18,252 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:18,252 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:18,252 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. started... 2023-09-17 17:02:18,252 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 88da8cf4b312157ee21e53b16cad60df 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-17 17:02:18,253 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 17:02:18,253 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:18,253 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 17:02:18,281 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917987c4fe053f64e20a6006bd0da817114 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917987c4fe053f64e20a6006bd0da817114 2023-09-17 17:02:18,282 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230917bd1ad43754274ea2b9ed4b5b56cc7d1f to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917bd1ad43754274ea2b9ed4b5b56cc7d1f 2023-09-17 17:02:18,301 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/.tmp/cf/b237fe8c457b428cbaa8d1d1abf72870 2023-09-17 17:02:18,301 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/.tmp/cf/779fce10eabd4fed9fc522d1569e157b 2023-09-17 17:02:18,306 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/.tmp/cf/b237fe8c457b428cbaa8d1d1abf72870 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf/b237fe8c457b428cbaa8d1d1abf72870 2023-09-17 17:02:18,306 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/.tmp/cf/779fce10eabd4fed9fc522d1569e157b as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf/779fce10eabd4fed9fc522d1569e157b 2023-09-17 17:02:18,312 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf/779fce10eabd4fed9fc522d1569e157b, entries=46, sequenceid=6, filesize=13.4 K 2023-09-17 17:02:18,312 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf/b237fe8c457b428cbaa8d1d1abf72870, entries=4, sequenceid=6, filesize=5.6 K 2023-09-17 17:02:18,313 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a0e43c1688cc320a711ee97a18554554 in 61ms, sequenceid=6, compaction requested=false 2023-09-17 17:02:18,313 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-17 17:02:18,313 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 88da8cf4b312157ee21e53b16cad60df in 61ms, sequenceid=6, compaction requested=false 2023-09-17 17:02:18,313 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0e43c1688cc320a711ee97a18554554: 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88da8cf4b312157ee21e53b16cad60df: 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf/779fce10eabd4fed9fc522d1569e157b] hfiles 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf/b237fe8c457b428cbaa8d1d1abf72870] hfiles 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf/779fce10eabd4fed9fc522d1569e157b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,315 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf/b237fe8c457b428cbaa8d1d1abf72870 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,320 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:18,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-17 17:02:18,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:02:18,322 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:02:18,323 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. completed. 2023-09-17 17:02:18,323 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,323 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. completed. 2023-09-17 17:02:18,323 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 17:02:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:02:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 17:02:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 17:02:18,326 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,327 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:18,327 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 17:02:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:18,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:18,327 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 17:02:18,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:18,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:18,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:02:18,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-17 17:02:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:18,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:18,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:18,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:02:18,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-17 17:02:18,335 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-17 17:02:18,335 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:02:18,335 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:02:18,335 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,335 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:02:18,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:18,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:18,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:18,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,340 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:18,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:18,341 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,342 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:18,343 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,343 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,344 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,346 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,346 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,346 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:18,346 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:18,346 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:18,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:18,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,346 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:18,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,346 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:18,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:18,346 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:18,346 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:18,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:18,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:18,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,348 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:18,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:18,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917bd1ad43754274ea2b9ed4b5b56cc7d1f, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917987c4fe053f64e20a6006bd0da817114] mob files 2023-09-17 17:02:18,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917bd1ad43754274ea2b9ed4b5b56cc7d1f 2023-09-17 17:02:18,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917987c4fe053f64e20a6006bd0da817114 2023-09-17 17:02:18,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-17 17:02:18,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,382 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:18,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694970138219Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694970138359 (+140 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694970138359Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694970138359Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694970138362 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694970138373 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694970138381 (+8 ms) 2023-09-17 17:02:18,384 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 17:02:18,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 164 msec 2023-09-17 17:02:18,522 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:18,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-17 17:02:18,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:02:18,551 DEBUG [Listener at jenkins-hbase4.apache.org/42231] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 17:02:18,554 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 17:02:18,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35553] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-17 17:02:18,556 DEBUG [Listener at jenkins-hbase4.apache.org/42231] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 17:02:18,560 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 17:02:18,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-17 17:02:18,561 DEBUG [Listener at jenkins-hbase4.apache.org/42231] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 17:02:18,563 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 17:02:18,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46223] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-17 17:02:18,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-17 17:02:18,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:18,568 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:02:18,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-17 17:02:18,569 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:02:18,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-17 17:02:18,571 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,571 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,572 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb empty. 2023-09-17 17:02:18,572 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8 empty. 2023-09-17 17:02:18,572 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,572 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,572 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-17 17:02:18,583 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-17 17:02:18,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 76c51d7098ed02b7ba53f39bca4d48eb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:02:18,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 555e6cb3a569b149e3f2f964c3e02ae8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 76c51d7098ed02b7ba53f39bca4d48eb, disabling compactions & flushes 2023-09-17 17:02:18,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 555e6cb3a569b149e3f2f964c3e02ae8, disabling compactions & flushes 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. after waiting 0 ms 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:18,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:18,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. after waiting 0 ms 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 76c51d7098ed02b7ba53f39bca4d48eb: 2023-09-17 17:02:18,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:18,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 555e6cb3a569b149e3f2f964c3e02ae8: 2023-09-17 17:02:18,597 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:02:18,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970138598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970138598"}]},"ts":"1694970138598"} 2023-09-17 17:02:18,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970138598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970138598"}]},"ts":"1694970138598"} 2023-09-17 17:02:18,600 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 17:02:18,601 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:02:18,601 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970138601"}]},"ts":"1694970138601"} 2023-09-17 17:02:18,602 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-17 17:02:18,605 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:02:18,606 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:02:18,606 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:02:18,606 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:02:18,606 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:02:18,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76c51d7098ed02b7ba53f39bca4d48eb, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=555e6cb3a569b149e3f2f964c3e02ae8, ASSIGN}] 2023-09-17 17:02:18,609 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=555e6cb3a569b149e3f2f964c3e02ae8, ASSIGN 2023-09-17 17:02:18,609 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76c51d7098ed02b7ba53f39bca4d48eb, ASSIGN 2023-09-17 17:02:18,613 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76c51d7098ed02b7ba53f39bca4d48eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:02:18,613 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=555e6cb3a569b149e3f2f964c3e02ae8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46223,1694970066168; forceNewPlan=false, retain=false 2023-09-17 17:02:18,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-17 17:02:18,763 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 17:02:18,767 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=76c51d7098ed02b7ba53f39bca4d48eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,767 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=555e6cb3a569b149e3f2f964c3e02ae8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,767 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970138767"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970138767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970138767"}]},"ts":"1694970138767"} 2023-09-17 17:02:18,767 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970138767"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970138767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970138767"}]},"ts":"1694970138767"} 2023-09-17 17:02:18,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 555e6cb3a569b149e3f2f964c3e02ae8, server=jenkins-hbase4.apache.org,46223,1694970066168}] 2023-09-17 17:02:18,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 76c51d7098ed02b7ba53f39bca4d48eb, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:18,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-17 17:02:18,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:18,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 555e6cb3a569b149e3f2f964c3e02ae8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.', STARTKEY => '2', ENDKEY => ''} 2023-09-17 17:02:18,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:18,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. service=AccessControlService 2023-09-17 17:02:18,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76c51d7098ed02b7ba53f39bca4d48eb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.', STARTKEY => '', ENDKEY => '2'} 2023-09-17 17:02:18,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:18,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:18,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. service=AccessControlService 2023-09-17 17:02:18,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:18,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:18,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,926 INFO [StoreOpener-555e6cb3a569b149e3f2f964c3e02ae8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,927 INFO [StoreOpener-76c51d7098ed02b7ba53f39bca4d48eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,928 DEBUG [StoreOpener-555e6cb3a569b149e3f2f964c3e02ae8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf 2023-09-17 17:02:18,928 DEBUG [StoreOpener-555e6cb3a569b149e3f2f964c3e02ae8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf 2023-09-17 17:02:18,928 INFO [StoreOpener-555e6cb3a569b149e3f2f964c3e02ae8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 555e6cb3a569b149e3f2f964c3e02ae8 columnFamilyName cf 2023-09-17 17:02:18,928 DEBUG [StoreOpener-76c51d7098ed02b7ba53f39bca4d48eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf 2023-09-17 17:02:18,928 DEBUG [StoreOpener-76c51d7098ed02b7ba53f39bca4d48eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf 2023-09-17 17:02:18,929 INFO [StoreOpener-76c51d7098ed02b7ba53f39bca4d48eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76c51d7098ed02b7ba53f39bca4d48eb columnFamilyName cf 2023-09-17 17:02:18,929 INFO [StoreOpener-555e6cb3a569b149e3f2f964c3e02ae8-1] regionserver.HStore(310): Store=555e6cb3a569b149e3f2f964c3e02ae8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:18,929 INFO [StoreOpener-76c51d7098ed02b7ba53f39bca4d48eb-1] regionserver.HStore(310): Store=76c51d7098ed02b7ba53f39bca4d48eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:18,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:18,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:18,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:02:18,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:02:18,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 555e6cb3a569b149e3f2f964c3e02ae8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68587272, jitterRate=0.022029995918273926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:18,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76c51d7098ed02b7ba53f39bca4d48eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59310213, jitterRate=-0.11620895564556122}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:18,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 555e6cb3a569b149e3f2f964c3e02ae8: 2023-09-17 17:02:18,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76c51d7098ed02b7ba53f39bca4d48eb: 2023-09-17 17:02:18,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb., pid=70, masterSystemTime=1694970138922 2023-09-17 17:02:18,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8., pid=69, masterSystemTime=1694970138921 2023-09-17 17:02:18,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:18,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:18,938 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=76c51d7098ed02b7ba53f39bca4d48eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:18,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970138938"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970138938"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970138938"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970138938"}]},"ts":"1694970138938"} 2023-09-17 17:02:18,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:18,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:18,939 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=555e6cb3a569b149e3f2f964c3e02ae8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:18,939 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970138939"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970138939"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970138939"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970138939"}]},"ts":"1694970138939"} 2023-09-17 17:02:18,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-17 17:02:18,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 76c51d7098ed02b7ba53f39bca4d48eb, server=jenkins-hbase4.apache.org,42773,1694970066257 in 170 msec 2023-09-17 17:02:18,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-17 17:02:18,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 555e6cb3a569b149e3f2f964c3e02ae8, server=jenkins-hbase4.apache.org,46223,1694970066168 in 172 msec 2023-09-17 17:02:18,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76c51d7098ed02b7ba53f39bca4d48eb, ASSIGN in 335 msec 2023-09-17 17:02:18,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-17 17:02:18,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=555e6cb3a569b149e3f2f964c3e02ae8, ASSIGN in 336 msec 2023-09-17 17:02:18,945 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:02:18,945 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970138945"}]},"ts":"1694970138945"} 2023-09-17 17:02:18,947 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-17 17:02:18,949 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:02:18,949 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-17 17:02:18,951 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-17 17:02:18,952 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:18,952 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:18,952 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:18,952 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:18,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:18,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:18,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:18,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:18,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:18,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:18,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:18,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:18,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 389 msec 2023-09-17 17:02:19,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-17 17:02:19,172 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-17 17:02:19,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 76c51d7098ed02b7ba53f39bca4d48eb, 555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:19,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76c51d7098ed02b7ba53f39bca4d48eb, 555e6cb3a569b149e3f2f964c3e02ae8], force=true 2023-09-17 17:02:19,202 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76c51d7098ed02b7ba53f39bca4d48eb, 555e6cb3a569b149e3f2f964c3e02ae8], force=true 2023-09-17 17:02:19,202 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76c51d7098ed02b7ba53f39bca4d48eb, 555e6cb3a569b149e3f2f964c3e02ae8], force=true 2023-09-17 17:02:19,203 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76c51d7098ed02b7ba53f39bca4d48eb, 555e6cb3a569b149e3f2f964c3e02ae8], force=true 2023-09-17 17:02:19,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 17:02:19,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76c51d7098ed02b7ba53f39bca4d48eb, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=555e6cb3a569b149e3f2f964c3e02ae8, UNASSIGN}] 2023-09-17 17:02:19,225 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76c51d7098ed02b7ba53f39bca4d48eb, UNASSIGN 2023-09-17 17:02:19,225 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=555e6cb3a569b149e3f2f964c3e02ae8, UNASSIGN 2023-09-17 17:02:19,225 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=76c51d7098ed02b7ba53f39bca4d48eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:19,225 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=555e6cb3a569b149e3f2f964c3e02ae8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:19,225 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970139225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970139225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970139225"}]},"ts":"1694970139225"} 2023-09-17 17:02:19,225 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970139225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970139225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970139225"}]},"ts":"1694970139225"} 2023-09-17 17:02:19,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 76c51d7098ed02b7ba53f39bca4d48eb, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:19,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 555e6cb3a569b149e3f2f964c3e02ae8, server=jenkins-hbase4.apache.org,46223,1694970066168}] 2023-09-17 17:02:19,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 17:02:19,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:19,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76c51d7098ed02b7ba53f39bca4d48eb, disabling compactions & flushes 2023-09-17 17:02:19,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:19,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:19,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. after waiting 0 ms 2023-09-17 17:02:19,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:19,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 76c51d7098ed02b7ba53f39bca4d48eb 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-17 17:02:19,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:19,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 555e6cb3a569b149e3f2f964c3e02ae8, disabling compactions & flushes 2023-09-17 17:02:19,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:19,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:19,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. after waiting 0 ms 2023-09-17 17:02:19,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:19,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 555e6cb3a569b149e3f2f964c3e02ae8 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-17 17:02:19,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/.tmp/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c 2023-09-17 17:02:19,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/.tmp/cf/eb8b4a1796864b32b9ca07648cb1280f 2023-09-17 17:02:19,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/.tmp/cf/eb8b4a1796864b32b9ca07648cb1280f as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf/eb8b4a1796864b32b9ca07648cb1280f 2023-09-17 17:02:19,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/.tmp/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c 2023-09-17 17:02:19,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf/eb8b4a1796864b32b9ca07648cb1280f, entries=1, sequenceid=5, filesize=4.7 K 2023-09-17 17:02:19,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c, entries=1, sequenceid=5, filesize=4.7 K 2023-09-17 17:02:19,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 76c51d7098ed02b7ba53f39bca4d48eb in 30ms, sequenceid=5, compaction requested=false 2023-09-17 17:02:19,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 555e6cb3a569b149e3f2f964c3e02ae8 in 28ms, sequenceid=5, compaction requested=false 2023-09-17 17:02:19,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-17 17:02:19,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-17 17:02:19,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-17 17:02:19,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-17 17:02:19,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:19,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:19,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb. 2023-09-17 17:02:19,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8. 2023-09-17 17:02:19,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76c51d7098ed02b7ba53f39bca4d48eb: 2023-09-17 17:02:19,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 555e6cb3a569b149e3f2f964c3e02ae8: 2023-09-17 17:02:19,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:19,422 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=555e6cb3a569b149e3f2f964c3e02ae8, regionState=CLOSED 2023-09-17 17:02:19,422 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970139422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970139422"}]},"ts":"1694970139422"} 2023-09-17 17:02:19,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:19,423 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=76c51d7098ed02b7ba53f39bca4d48eb, regionState=CLOSED 2023-09-17 17:02:19,423 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694970139423"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970139423"}]},"ts":"1694970139423"} 2023-09-17 17:02:19,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-17 17:02:19,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 555e6cb3a569b149e3f2f964c3e02ae8, server=jenkins-hbase4.apache.org,46223,1694970066168 in 197 msec 2023-09-17 17:02:19,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-17 17:02:19,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 76c51d7098ed02b7ba53f39bca4d48eb, server=jenkins-hbase4.apache.org,42773,1694970066257 in 197 msec 2023-09-17 17:02:19,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=555e6cb3a569b149e3f2f964c3e02ae8, UNASSIGN in 202 msec 2023-09-17 17:02:19,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-17 17:02:19,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76c51d7098ed02b7ba53f39bca4d48eb, UNASSIGN in 206 msec 2023-09-17 17:02:19,473 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-17 17:02:19,475 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138565.76c51d7098ed02b7ba53f39bca4d48eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:19,475 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694970138565.555e6cb3a569b149e3f2f964c3e02ae8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:19,475 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:19,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 17:02:19,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab3b5af48531b0f42d1dd49ff2b7386, ASSIGN}] 2023-09-17 17:02:19,526 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab3b5af48531b0f42d1dd49ff2b7386, ASSIGN 2023-09-17 17:02:19,527 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab3b5af48531b0f42d1dd49ff2b7386, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:02:19,677 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-17 17:02:19,679 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dab3b5af48531b0f42d1dd49ff2b7386, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:19,679 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694970139679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970139679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970139679"}]},"ts":"1694970139679"} 2023-09-17 17:02:19,680 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure dab3b5af48531b0f42d1dd49ff2b7386, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:19,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 17:02:19,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:19,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dab3b5af48531b0f42d1dd49ff2b7386, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.', STARTKEY => '', ENDKEY => ''} 2023-09-17 17:02:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. service=AccessControlService 2023-09-17 17:02:19,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:19,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/.regioninfo 2023-09-17 17:02:19,846 INFO [StoreOpener-dab3b5af48531b0f42d1dd49ff2b7386-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:19,846 DEBUG [StoreOpener-dab3b5af48531b0f42d1dd49ff2b7386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf 2023-09-17 17:02:19,846 DEBUG [StoreOpener-dab3b5af48531b0f42d1dd49ff2b7386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf 2023-09-17 17:02:19,847 INFO [StoreOpener-dab3b5af48531b0f42d1dd49ff2b7386-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dab3b5af48531b0f42d1dd49ff2b7386 columnFamilyName cf 2023-09-17 17:02:19,876 DEBUG [StoreOpener-dab3b5af48531b0f42d1dd49ff2b7386-1] regionserver.HStore(539): loaded hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c.555e6cb3a569b149e3f2f964c3e02ae8->hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c-top 2023-09-17 17:02:19,882 DEBUG [StoreOpener-dab3b5af48531b0f42d1dd49ff2b7386-1] regionserver.HStore(539): loaded hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/eb8b4a1796864b32b9ca07648cb1280f.76c51d7098ed02b7ba53f39bca4d48eb->hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf/eb8b4a1796864b32b9ca07648cb1280f-top 2023-09-17 17:02:19,882 INFO [StoreOpener-dab3b5af48531b0f42d1dd49ff2b7386-1] regionserver.HStore(310): Store=dab3b5af48531b0f42d1dd49ff2b7386/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:19,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:19,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:19,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:19,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dab3b5af48531b0f42d1dd49ff2b7386; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65635921, jitterRate=-0.02194856107234955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:19,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dab3b5af48531b0f42d1dd49ff2b7386: 2023-09-17 17:02:19,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386., pid=77, masterSystemTime=1694970139832 2023-09-17 17:02:19,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.,because compaction is disabled. 2023-09-17 17:02:19,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:19,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:19,890 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dab3b5af48531b0f42d1dd49ff2b7386, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:19,891 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694970139890"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970139890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970139890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970139890"}]},"ts":"1694970139890"} 2023-09-17 17:02:19,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-17 17:02:19,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure dab3b5af48531b0f42d1dd49ff2b7386, server=jenkins-hbase4.apache.org,42773,1694970066257 in 212 msec 2023-09-17 17:02:19,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-17 17:02:19,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab3b5af48531b0f42d1dd49ff2b7386, ASSIGN in 368 msec 2023-09-17 17:02:19,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76c51d7098ed02b7ba53f39bca4d48eb, 555e6cb3a569b149e3f2f964c3e02ae8], force=true in 699 msec 2023-09-17 17:02:20,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 17:02:20,309 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-17 17:02:20,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-17 17:02:20,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970140310 (current time:1694970140310). 2023-09-17 17:02:20,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:02:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x5fb80e1d to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:20,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44dd16d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:20,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:20,320 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:20,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fb80e1d to 127.0.0.1:59728 2023-09-17 17:02:20,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:20,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x4be001c2 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:20,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54372645, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:20,328 DEBUG [hconnection-0x78f0f1a1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:20,331 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:20,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4be001c2 to 127.0.0.1:59728 2023-09-17 17:02:20,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:20,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-17 17:02:20,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:02:20,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-17 17:02:20,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-17 17:02:20,339 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-17 17:02:20,340 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694970740340 2023-09-17 17:02:20,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-17 17:02:20,343 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:02:20,343 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:02:20,344 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-17 17:02:20,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-17 17:02:20,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-09-17 17:02:20,346 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-17 17:02:20,346 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694970740346 2023-09-17 17:02:20,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,357 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-17 17:02:20,357 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:20,358 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-17 17:02:20,358 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-17 17:02:20,358 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,358 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,360 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:20,360 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:20,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:20,360 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:20,360 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:20,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:20,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:20,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,361 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,361 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-17 17:02:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,362 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-17 17:02:20,362 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-17 17:02:20,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-17 17:02:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-17 17:02:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:20,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-17 17:02:20,363 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-17 17:02:20,363 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-17 17:02:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,363 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-17 17:02:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:20,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-17 17:02:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-17 17:02:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-17 17:02:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-17 17:02:20,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-17 17:02:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:20,365 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-17 17:02:20,365 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-17 17:02:20,365 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-17 17:02:20,366 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:20,368 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,368 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:20,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:20,368 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,368 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:20,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:20,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:20,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:20,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-17 17:02:20,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@256ff82a[Count = 0] remaining members to acquire global barrier 2023-09-17 17:02:20,370 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-17 17:02:20,370 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-17 17:02:20,372 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,372 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:02:20,372 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-17 17:02:20,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:02:20,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,372 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-17 17:02:20,372 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-17 17:02:20,372 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-17 17:02:20,373 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:02:20,373 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:20,373 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:20,373 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:20,373 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. started... 2023-09-17 17:02:20,374 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dab3b5af48531b0f42d1dd49ff2b7386: 2023-09-17 17:02:20,374 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-17 17:02:20,374 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,374 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:20,374 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:20,374 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-17 17:02:20,375 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c.555e6cb3a569b149e3f2f964c3e02ae8->hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c-top, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/eb8b4a1796864b32b9ca07648cb1280f.76c51d7098ed02b7ba53f39bca4d48eb->hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf/eb8b4a1796864b32b9ca07648cb1280f-top] hfiles 2023-09-17 17:02:20,375 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-17 17:02:20,375 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:20,375 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c.555e6cb3a569b149e3f2f964c3e02ae8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,375 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-17 17:02:20,379 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/eb8b4a1796864b32b9ca07648cb1280f.76c51d7098ed02b7ba53f39bca4d48eb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,385 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. completed. 2023-09-17 17:02:20,385 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:20,385 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:20,385 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:20,385 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,385 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-17 17:02:20,385 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:02:20,390 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-17 17:02:20,390 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:20,390 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,390 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-17 17:02:20,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:20,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:20,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:20,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:20,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:20,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:02:20,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-17 17:02:20,394 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-17 17:02:20,394 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:02:20,394 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:02:20,394 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,394 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:02:20,395 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:20,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,395 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:20,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:20,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:20,397 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,425 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:20,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:20,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:20,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,425 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:20,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,430 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,431 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,431 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:20,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:20,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:20,434 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:20,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:20,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:20,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:20,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:20,434 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:20,435 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:20,435 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:20,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:20,435 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:20,435 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,435 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:20,435 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:20,435 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,436 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:20,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:20,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:20,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:20,444 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:20,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-17 17:02:20,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:02:20,445 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:02:20,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-17 17:02:20,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,456 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694970140340Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694970140435 (+95 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694970140435Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694970140442 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694970140449 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694970140456 (+7 ms) 2023-09-17 17:02:20,459 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-17 17:02:20,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 116 msec 2023-09-17 17:02:20,645 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:20,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-17 17:02:20,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:02:20,646 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646 2023-09-17 17:02:20,647 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35449, tgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646, rawTgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646, srcFsUri=hdfs://localhost:35449, srcDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:02:20,668 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:02:20,668 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_941925772_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,668 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3, snapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-17 17:02:20,676 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:20,692 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:20,693 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:20,693 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:20,693 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,561 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-6430006462054228649.jar 2023-09-17 17:02:21,561 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,562 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,576 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0004_000001 (auth:SIMPLE) 2023-09-17 17:02:21,632 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-536847519163575378.jar 2023-09-17 17:02:21,633 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,633 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,633 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,634 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,634 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,634 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:21,635 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 17:02:21,636 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 17:02:21,636 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 17:02:21,636 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 17:02:21,637 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 17:02:21,637 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 17:02:21,638 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 17:02:21,638 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 17:02:21,638 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 17:02:21,639 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 17:02:21,639 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:21,640 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:21,640 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:21,640 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:21,641 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:21,641 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:21,642 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:22,018 WARN [Listener at jenkins-hbase4.apache.org/42231] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 17:02:22,020 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-17 17:02:22,022 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-17 17:02:22,073 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:02:22,074 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:02:22,491 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 17:02:22,509 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0005_000001 (auth:SIMPLE) 2023-09-17 17:02:26,167 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0005_000001 (auth:SIMPLE) 2023-09-17 17:02:28,375 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0005_000001 (auth:SIMPLE) 2023-09-17 17:02:30,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0005_000001 (auth:SIMPLE) 2023-09-17 17:02:32,169 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 17:02:32,171 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 17:02:32,181 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,181 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 17:02:32,182 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 17:02:32,182 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,182 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-17 17:02:32,182 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-17 17:02:32,182 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,183 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-17 17:02:32,183 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970140646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-17 17:02:32,188 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-17 17:02:32,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970152193"}]},"ts":"1694970152193"} 2023-09-17 17:02:32,194 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-17 17:02:32,196 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-17 17:02:32,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab3b5af48531b0f42d1dd49ff2b7386, UNASSIGN}] 2023-09-17 17:02:32,198 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab3b5af48531b0f42d1dd49ff2b7386, UNASSIGN 2023-09-17 17:02:32,199 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dab3b5af48531b0f42d1dd49ff2b7386, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:32,199 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694970152199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970152199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970152199"}]},"ts":"1694970152199"} 2023-09-17 17:02:32,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure dab3b5af48531b0f42d1dd49ff2b7386, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:32,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-17 17:02:32,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:32,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dab3b5af48531b0f42d1dd49ff2b7386, disabling compactions & flushes 2023-09-17 17:02:32,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:32,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:32,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. after waiting 0 ms 2023-09-17 17:02:32,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:32,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-17 17:02:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:32,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386. 2023-09-17 17:02:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dab3b5af48531b0f42d1dd49ff2b7386: 2023-09-17 17:02:32,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:32,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dab3b5af48531b0f42d1dd49ff2b7386, regionState=CLOSED 2023-09-17 17:02:32,366 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694970152366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970152366"}]},"ts":"1694970152366"} 2023-09-17 17:02:32,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-17 17:02:32,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure dab3b5af48531b0f42d1dd49ff2b7386, server=jenkins-hbase4.apache.org,42773,1694970066257 in 168 msec 2023-09-17 17:02:32,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-17 17:02:32,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab3b5af48531b0f42d1dd49ff2b7386, UNASSIGN in 173 msec 2023-09-17 17:02:32,371 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970152371"}]},"ts":"1694970152371"} 2023-09-17 17:02:32,372 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-17 17:02:32,373 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-17 17:02:32,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-17 17:02:32,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-17 17:02:32,495 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-17 17:02:32,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,499 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,499 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,501 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,503 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:32,503 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:32,503 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:32,504 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,504 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,504 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,504 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-17 17:02:32,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-17 17:02:32,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-17 17:02:32,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-17 17:02:32,506 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/recovered.edits] 2023-09-17 17:02:32,506 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/recovered.edits] 2023-09-17 17:02:32,506 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/recovered.edits] 2023-09-17 17:02:32,506 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,506 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,506 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,506 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,506 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:32,506 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:32,506 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:32,506 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:32,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-17 17:02:32,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:32,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:32,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:32,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:32,511 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf/eb8b4a1796864b32b9ca07648cb1280f to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/cf/eb8b4a1796864b32b9ca07648cb1280f 2023-09-17 17:02:32,511 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c 2023-09-17 17:02:32,513 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c.555e6cb3a569b149e3f2f964c3e02ae8 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/9fa9aa8898ff4fc7aa1e7d0e89d2057c.555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:32,514 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/recovered.edits/8.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8/recovered.edits/8.seqid 2023-09-17 17:02:32,515 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/555e6cb3a569b149e3f2f964c3e02ae8 2023-09-17 17:02:32,515 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/eb8b4a1796864b32b9ca07648cb1280f.76c51d7098ed02b7ba53f39bca4d48eb to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/cf/eb8b4a1796864b32b9ca07648cb1280f.76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:32,516 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/recovered.edits/8.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb/recovered.edits/8.seqid 2023-09-17 17:02:32,517 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76c51d7098ed02b7ba53f39bca4d48eb 2023-09-17 17:02:32,519 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/recovered.edits/12.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386/recovered.edits/12.seqid 2023-09-17 17:02:32,519 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab3b5af48531b0f42d1dd49ff2b7386 2023-09-17 17:02:32,519 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-17 17:02:32,521 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,523 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-17 17:02:32,525 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-17 17:02:32,526 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,526 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-17 17:02:32,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970152526"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:32,527 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-17 17:02:32,527 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dab3b5af48531b0f42d1dd49ff2b7386, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694970138566.dab3b5af48531b0f42d1dd49ff2b7386.', STARTKEY => '', ENDKEY => ''}] 2023-09-17 17:02:32,527 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-17 17:02:32,528 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694970152527"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:32,531 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-17 17:02:32,533 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:32,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 37 msec 2023-09-17 17:02:32,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-17 17:02:32,608 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-17 17:02:32,609 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-17 17:02:32,614 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970152613"}]},"ts":"1694970152613"} 2023-09-17 17:02:32,615 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-17 17:02:32,616 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-17 17:02:32,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88da8cf4b312157ee21e53b16cad60df, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a0e43c1688cc320a711ee97a18554554, UNASSIGN}] 2023-09-17 17:02:32,619 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88da8cf4b312157ee21e53b16cad60df, UNASSIGN 2023-09-17 17:02:32,619 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a0e43c1688cc320a711ee97a18554554, UNASSIGN 2023-09-17 17:02:32,619 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=88da8cf4b312157ee21e53b16cad60df, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:32,619 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a0e43c1688cc320a711ee97a18554554, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:32,620 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970152619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970152619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970152619"}]},"ts":"1694970152619"} 2023-09-17 17:02:32,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970152619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970152619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970152619"}]},"ts":"1694970152619"} 2023-09-17 17:02:32,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure a0e43c1688cc320a711ee97a18554554, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:02:32,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 88da8cf4b312157ee21e53b16cad60df, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:32,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-17 17:02:32,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:32,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a0e43c1688cc320a711ee97a18554554, disabling compactions & flushes 2023-09-17 17:02:32,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:32,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:32,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. after waiting 0 ms 2023-09-17 17:02:32,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:32,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:32,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88da8cf4b312157ee21e53b16cad60df, disabling compactions & flushes 2023-09-17 17:02:32,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:32,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:32,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. after waiting 0 ms 2023-09-17 17:02:32,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:32,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:02:32,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:02:32,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:32,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:32,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554. 2023-09-17 17:02:32,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df. 2023-09-17 17:02:32,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88da8cf4b312157ee21e53b16cad60df: 2023-09-17 17:02:32,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a0e43c1688cc320a711ee97a18554554: 2023-09-17 17:02:32,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:32,788 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=88da8cf4b312157ee21e53b16cad60df, regionState=CLOSED 2023-09-17 17:02:32,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:32,788 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970152788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970152788"}]},"ts":"1694970152788"} 2023-09-17 17:02:32,789 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a0e43c1688cc320a711ee97a18554554, regionState=CLOSED 2023-09-17 17:02:32,789 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694970152789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970152789"}]},"ts":"1694970152789"} 2023-09-17 17:02:32,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-17 17:02:32,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 88da8cf4b312157ee21e53b16cad60df, server=jenkins-hbase4.apache.org,42773,1694970066257 in 168 msec 2023-09-17 17:02:32,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-17 17:02:32,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure a0e43c1688cc320a711ee97a18554554, server=jenkins-hbase4.apache.org,35553,1694970066217 in 170 msec 2023-09-17 17:02:32,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88da8cf4b312157ee21e53b16cad60df, UNASSIGN in 175 msec 2023-09-17 17:02:32,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-17 17:02:32,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a0e43c1688cc320a711ee97a18554554, UNASSIGN in 176 msec 2023-09-17 17:02:32,795 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970152795"}]},"ts":"1694970152795"} 2023-09-17 17:02:32,796 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-17 17:02:32,798 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-17 17:02:32,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 190 msec 2023-09-17 17:02:32,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-17 17:02:32,916 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-17 17:02:32,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,919 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,920 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,921 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,924 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,924 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,924 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,924 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,924 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:32,924 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-17 17:02:32,924 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-17 17:02:32,924 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-17 17:02:32,924 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:32,924 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-17 17:02:32,926 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,926 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,926 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:32,926 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:32,926 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,926 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:32,926 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,926 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/recovered.edits] 2023-09-17 17:02:32,926 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:32,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/recovered.edits] 2023-09-17 17:02:32,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-17 17:02:32,930 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf/779fce10eabd4fed9fc522d1569e157b to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/cf/779fce10eabd4fed9fc522d1569e157b 2023-09-17 17:02:32,930 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf/b237fe8c457b428cbaa8d1d1abf72870 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/cf/b237fe8c457b428cbaa8d1d1abf72870 2023-09-17 17:02:32,933 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554/recovered.edits/9.seqid 2023-09-17 17:02:32,934 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df/recovered.edits/9.seqid 2023-09-17 17:02:32,934 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a0e43c1688cc320a711ee97a18554554 2023-09-17 17:02:32,934 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88da8cf4b312157ee21e53b16cad60df 2023-09-17 17:02:32,934 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-17 17:02:32,935 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-17 17:02:32,935 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-17 17:02:32,938 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917bd1ad43754274ea2b9ed4b5b56cc7d1f to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917bd1ad43754274ea2b9ed4b5b56cc7d1f 2023-09-17 17:02:32,939 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917987c4fe053f64e20a6006bd0da817114 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917987c4fe053f64e20a6006bd0da817114 2023-09-17 17:02:32,940 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-17 17:02:32,941 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,943 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-17 17:02:32,945 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-17 17:02:32,946 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,946 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-17 17:02:32,946 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970152946"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:32,946 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970152946"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:32,947 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 17:02:32,947 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 88da8cf4b312157ee21e53b16cad60df, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694970137209.88da8cf4b312157ee21e53b16cad60df.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a0e43c1688cc320a711ee97a18554554, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694970137209.a0e43c1688cc320a711ee97a18554554.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 17:02:32,947 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-17 17:02:32,947 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694970152947"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:32,949 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-17 17:02:32,952 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:32,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-09-17 17:02:33,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-17 17:02:33,028 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-17 17:02:33,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-17 17:02:33,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:33,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-17 17:02:33,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 17:02:33,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-17 17:02:33,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 17:02:33,068 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 752) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:35364 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:43197 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:44668 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3958 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:41758 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1517619208_1 at /127.0.0.1:35346 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 215), ProcessCount=168 (was 168), AvailableMemoryMB=9170 (was 9280) 2023-09-17 17:02:33,068 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-17 17:02:33,087 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=198, ProcessCount=168, AvailableMemoryMB=9170 2023-09-17 17:02:33,088 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-17 17:02:33,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 17:02:33,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 17:02:33,092 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:02:33,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-17 17:02:33,093 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:02:33,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-17 17:02:33,095 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,095 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,096 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06 empty. 2023-09-17 17:02:33,096 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e empty. 2023-09-17 17:02:33,096 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,096 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,096 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-17 17:02:33,106 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-17 17:02:33,107 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b5193e09f72a27db4e379a379286f06, NAME => 'testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:02:33,107 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 816fc22edae4e82ccf4a823c85ba9b8e, NAME => 'testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5b5193e09f72a27db4e379a379286f06, disabling compactions & flushes 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 816fc22edae4e82ccf4a823c85ba9b8e, disabling compactions & flushes 2023-09-17 17:02:33,123 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,123 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. after waiting 0 ms 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,123 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5b5193e09f72a27db4e379a379286f06: 2023-09-17 17:02:33,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. after waiting 0 ms 2023-09-17 17:02:33,124 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,124 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,124 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 816fc22edae4e82ccf4a823c85ba9b8e: 2023-09-17 17:02:33,126 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:02:33,127 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970153126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970153126"}]},"ts":"1694970153126"} 2023-09-17 17:02:33,127 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970153126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970153126"}]},"ts":"1694970153126"} 2023-09-17 17:02:33,129 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 17:02:33,130 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:02:33,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970153130"}]},"ts":"1694970153130"} 2023-09-17 17:02:33,131 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-17 17:02:33,134 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:02:33,135 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:02:33,135 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:02:33,135 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:02:33,135 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:02:33,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b5193e09f72a27db4e379a379286f06, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=816fc22edae4e82ccf4a823c85ba9b8e, ASSIGN}] 2023-09-17 17:02:33,138 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b5193e09f72a27db4e379a379286f06, ASSIGN 2023-09-17 17:02:33,138 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=816fc22edae4e82ccf4a823c85ba9b8e, ASSIGN 2023-09-17 17:02:33,138 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b5193e09f72a27db4e379a379286f06, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35553,1694970066217; forceNewPlan=false, retain=false 2023-09-17 17:02:33,139 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=816fc22edae4e82ccf4a823c85ba9b8e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:02:33,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-17 17:02:33,289 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 17:02:33,291 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=816fc22edae4e82ccf4a823c85ba9b8e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,291 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5b5193e09f72a27db4e379a379286f06, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970153291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970153291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970153291"}]},"ts":"1694970153291"} 2023-09-17 17:02:33,292 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970153291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970153291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970153291"}]},"ts":"1694970153291"} 2023-09-17 17:02:33,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 5b5193e09f72a27db4e379a379286f06, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:02:33,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 816fc22edae4e82ccf4a823c85ba9b8e, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:33,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-17 17:02:33,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 816fc22edae4e82ccf4a823c85ba9b8e, NAME => 'testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 17:02:33,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. service=AccessControlService 2023-09-17 17:02:33,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b5193e09f72a27db4e379a379286f06, NAME => 'testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 17:02:33,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:33,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. service=AccessControlService 2023-09-17 17:02:33,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:33,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:33,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:33,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,450 INFO [StoreOpener-816fc22edae4e82ccf4a823c85ba9b8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,450 INFO [StoreOpener-5b5193e09f72a27db4e379a379286f06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,451 DEBUG [StoreOpener-5b5193e09f72a27db4e379a379286f06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf 2023-09-17 17:02:33,451 DEBUG [StoreOpener-5b5193e09f72a27db4e379a379286f06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf 2023-09-17 17:02:33,451 DEBUG [StoreOpener-816fc22edae4e82ccf4a823c85ba9b8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf 2023-09-17 17:02:33,451 DEBUG [StoreOpener-816fc22edae4e82ccf4a823c85ba9b8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf 2023-09-17 17:02:33,452 INFO [StoreOpener-816fc22edae4e82ccf4a823c85ba9b8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 816fc22edae4e82ccf4a823c85ba9b8e columnFamilyName cf 2023-09-17 17:02:33,452 INFO [StoreOpener-5b5193e09f72a27db4e379a379286f06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b5193e09f72a27db4e379a379286f06 columnFamilyName cf 2023-09-17 17:02:33,453 INFO [StoreOpener-816fc22edae4e82ccf4a823c85ba9b8e-1] regionserver.HStore(310): Store=816fc22edae4e82ccf4a823c85ba9b8e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:33,453 INFO [StoreOpener-5b5193e09f72a27db4e379a379286f06-1] regionserver.HStore(310): Store=5b5193e09f72a27db4e379a379286f06/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:33,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:33,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:33,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:02:33,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:02:33,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b5193e09f72a27db4e379a379286f06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62266391, jitterRate=-0.07215847074985504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:33,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b5193e09f72a27db4e379a379286f06: 2023-09-17 17:02:33,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 816fc22edae4e82ccf4a823c85ba9b8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60400320, jitterRate=-0.09996509552001953}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:33,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 816fc22edae4e82ccf4a823c85ba9b8e: 2023-09-17 17:02:33,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06., pid=93, masterSystemTime=1694970153445 2023-09-17 17:02:33,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e., pid=94, masterSystemTime=1694970153445 2023-09-17 17:02:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,461 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5b5193e09f72a27db4e379a379286f06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,462 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970153461"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970153461"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970153461"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970153461"}]},"ts":"1694970153461"} 2023-09-17 17:02:33,462 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=816fc22edae4e82ccf4a823c85ba9b8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,462 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970153462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970153462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970153462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970153462"}]},"ts":"1694970153462"} 2023-09-17 17:02:33,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-17 17:02:33,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 5b5193e09f72a27db4e379a379286f06, server=jenkins-hbase4.apache.org,35553,1694970066217 in 170 msec 2023-09-17 17:02:33,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-17 17:02:33,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 816fc22edae4e82ccf4a823c85ba9b8e, server=jenkins-hbase4.apache.org,42773,1694970066257 in 169 msec 2023-09-17 17:02:33,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b5193e09f72a27db4e379a379286f06, ASSIGN in 329 msec 2023-09-17 17:02:33,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-17 17:02:33,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=816fc22edae4e82ccf4a823c85ba9b8e, ASSIGN in 330 msec 2023-09-17 17:02:33,468 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:02:33,468 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970153468"}]},"ts":"1694970153468"} 2023-09-17 17:02:33,469 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-17 17:02:33,471 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:02:33,471 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-17 17:02:33,473 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 17:02:33,475 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:33,475 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:33,475 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:33,475 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:33,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:33,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:33,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:33,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:33,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 388 msec 2023-09-17 17:02:33,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-17 17:02:33,698 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-17 17:02:33,700 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-17 17:02:33,700 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,702 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:02:33,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:02:33,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970153713 (current time:1694970153713). 2023-09-17 17:02:33,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:02:33,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x35df5cce to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:33,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e771dec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:33,726 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:33,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35df5cce to 127.0.0.1:59728 2023-09-17 17:02:33,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:33,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x2ef6fcd1 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:33,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6100eced, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:33,735 DEBUG [hconnection-0x47be155c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:33,736 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:33,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ef6fcd1 to 127.0.0.1:59728 2023-09-17 17:02:33,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:33,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 17:02:33,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:02:33,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:02:33,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:02:33,744 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:02:33,745 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694970753745 2023-09-17 17:02:33,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:02:33,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-17 17:02:33,746 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:02:33,746 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:02:33,747 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:02:33,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 17:02:33,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-17 17:02:33,751 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 17:02:33,751 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694970753751 2023-09-17 17:02:33,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,761 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-17 17:02:33,761 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:33,761 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-17 17:02:33,761 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-17 17:02:33,762 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,762 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,768 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:33,768 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:33,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:33,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:33,768 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,768 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:33,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:33,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:33,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:33,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:33,769 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,769 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,769 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,769 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 17:02:33,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 17:02:33,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 17:02:33,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 17:02:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 17:02:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:33,771 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 17:02:33,771 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 17:02:33,772 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 17:02:33,772 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 17:02:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 17:02:33,771 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 17:02:33,772 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:33,772 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 17:02:33,772 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 17:02:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 17:02:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 17:02:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,775 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,775 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:33,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:33,776 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:33,777 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,777 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:33,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-17 17:02:33,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68dad50a[Count = 1] remaining members to acquire global barrier 2023-09-17 17:02:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:33,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-17 17:02:33,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68dad50a[Count = 0] remaining members to acquire global barrier 2023-09-17 17:02:33,781 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-17 17:02:33,781 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:02:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 17:02:33,784 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:33,784 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:02:33,784 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,785 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:02:33,784 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. started... 2023-09-17 17:02:33,784 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,785 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. started... 2023-09-17 17:02:33,786 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b5193e09f72a27db4e379a379286f06: 2023-09-17 17:02:33,786 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 816fc22edae4e82ccf4a823c85ba9b8e: 2023-09-17 17:02:33,786 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,786 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,786 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:33,786 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:33,786 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:02:33,786 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:02:33,787 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 17:02:33,787 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:33,787 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 17:02:33,797 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. completed. 2023-09-17 17:02:33,797 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:33,797 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:33,797 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:33,797 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,800 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 17:02:33,800 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:02:33,802 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,802 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 17:02:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:33,802 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:33,802 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 17:02:33,804 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. completed. 2023-09-17 17:02:33,804 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:33,804 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:33,804 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:33,804 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,804 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 17:02:33,804 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:02:33,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:33,806 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 17:02:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 17:02:33,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:02:33,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-17 17:02:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:02:33,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-17 17:02:33,812 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-17 17:02:33,812 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:02:33,812 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:02:33,813 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,813 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:02:33,815 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,815 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:33,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,815 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:33,815 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,815 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:33,816 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:33,816 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:33,816 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:33,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,817 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,817 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,818 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,819 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,819 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,821 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,821 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,821 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:33,821 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,821 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:33,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-17 17:02:33,822 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,822 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:33,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:33,822 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:33,823 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:33,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:33,822 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:33,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:33,822 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:33,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:02:33,823 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:33,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:33,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:33,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:33,823 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:33,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:33,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:33,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:33,824 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,824 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:33,824 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:33,824 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,824 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:33,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:33,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 17:02:33,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,846 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:33,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 17:02:33,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:02:33,847 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:02:33,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-17 17:02:33,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,855 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:33,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694970153745Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694970153833 (+88 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694970153833Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694970153833Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694970153837 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694970153848 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694970153854 (+6 ms) 2023-09-17 17:02:33,858 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 17:02:33,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 112 msec 2023-09-17 17:02:34,047 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:34,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 17:02:34,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:02:34,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35553] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:02:34,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:02:34,054 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-17 17:02:34,054 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:34,054 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:02:34,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:02:34,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970154063 (current time:1694970154063). 2023-09-17 17:02:34,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:02:34,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x71a5c243 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:34,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46863dde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:34,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:34,075 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:34,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71a5c243 to 127.0.0.1:59728 2023-09-17 17:02:34,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:34,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x1476f6c4 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:34,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b1e99d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:34,083 DEBUG [hconnection-0x3c8125a3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:34,086 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:34,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1476f6c4 to 127.0.0.1:59728 2023-09-17 17:02:34,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:34,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 17:02:34,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:02:34,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:02:34,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:02:34,093 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:02:34,094 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694970754094 2023-09-17 17:02:34,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 17:02:34,094 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-17 17:02:34,095 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:02:34,095 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:02:34,096 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 17:02:34,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 17:02:34,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-17 17:02:34,098 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 17:02:34,098 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694970754098 2023-09-17 17:02:34,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,108 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-17 17:02:34,108 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:34,109 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-17 17:02:34,109 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-17 17:02:34,110 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,110 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,111 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:34,111 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:34,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:34,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:34,111 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,111 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,111 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,112 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,112 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,112 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 17:02:34,112 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:34,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,114 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:34,114 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 17:02:34,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:34,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:34,114 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 17:02:34,114 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 17:02:34,114 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:34,114 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 17:02:34,115 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 17:02:34,115 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 17:02:34,115 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 17:02:34,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,116 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-17 17:02:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,118 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,118 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:34,118 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,118 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:34,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 17:02:34,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:34,118 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 17:02:34,118 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:34,118 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,121 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:34,121 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 17:02:34,121 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 17:02:34,121 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 17:02:34,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:34,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,123 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,123 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,123 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,123 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:34,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:34,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-17 17:02:34,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@104f9618[Count = 1] remaining members to acquire global barrier 2023-09-17 17:02:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:34,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:34,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-17 17:02:34,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@104f9618[Count = 0] remaining members to acquire global barrier 2023-09-17 17:02:34,126 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-17 17:02:34,126 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:02:34,130 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 17:02:34,130 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:34,130 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:02:34,130 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,131 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:02:34,130 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:34,130 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. started... 2023-09-17 17:02:34,131 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. started... 2023-09-17 17:02:34,131 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b5193e09f72a27db4e379a379286f06 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-17 17:02:34,131 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 816fc22edae4e82ccf4a823c85ba9b8e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-17 17:02:34,136 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 17:02:34,136 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:34,136 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 17:02:34,148 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309175416a09782f84a7fb227be576e141843 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309175416a09782f84a7fb227be576e141843 2023-09-17 17:02:34,150 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309175f2487feabaf4063a869fee41236cb58 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309175f2487feabaf4063a869fee41236cb58 2023-09-17 17:02:34,156 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/.tmp/cf/3e85a54af53e4510a8897e68e51d2e9c 2023-09-17 17:02:34,157 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/.tmp/cf/a37d12a589584ec6ab13504ea54e3a60 2023-09-17 17:02:34,161 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/.tmp/cf/3e85a54af53e4510a8897e68e51d2e9c as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf/3e85a54af53e4510a8897e68e51d2e9c 2023-09-17 17:02:34,162 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/.tmp/cf/a37d12a589584ec6ab13504ea54e3a60 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf/a37d12a589584ec6ab13504ea54e3a60 2023-09-17 17:02:34,166 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf/a37d12a589584ec6ab13504ea54e3a60, entries=47, sequenceid=6, filesize=13.1 K 2023-09-17 17:02:34,167 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf/3e85a54af53e4510a8897e68e51d2e9c, entries=3, sequenceid=6, filesize=5.4 K 2023-09-17 17:02:34,167 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 816fc22edae4e82ccf4a823c85ba9b8e in 36ms, sequenceid=6, compaction requested=false 2023-09-17 17:02:34,167 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-17 17:02:34,167 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 5b5193e09f72a27db4e379a379286f06 in 36ms, sequenceid=6, compaction requested=false 2023-09-17 17:02:34,168 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-17 17:02:34,170 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 816fc22edae4e82ccf4a823c85ba9b8e: 2023-09-17 17:02:34,170 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b5193e09f72a27db4e379a379286f06: 2023-09-17 17:02:34,170 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,171 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:34,171 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,171 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf/a37d12a589584ec6ab13504ea54e3a60] hfiles 2023-09-17 17:02:34,171 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:34,171 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf/a37d12a589584ec6ab13504ea54e3a60 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,171 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf/3e85a54af53e4510a8897e68e51d2e9c] hfiles 2023-09-17 17:02:34,171 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf/3e85a54af53e4510a8897e68e51d2e9c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,179 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. completed. 2023-09-17 17:02:34,179 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:34,179 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:34,179 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:34,179 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. completed. 2023-09-17 17:02:34,179 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:34,179 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,179 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:34,179 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:34,180 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,179 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 17:02:34,180 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 17:02:34,180 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:02:34,180 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:02:34,181 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 17:02:34,181 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 17:02:34,181 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:34,181 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,181 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 17:02:34,182 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,181 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:34,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:34,182 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 17:02:34,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:34,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:34,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:34,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:02:34,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-17 17:02:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:34,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:02:34,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-17 17:02:34,189 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-17 17:02:34,189 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:02:34,189 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:02:34,189 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,189 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:02:34,191 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:34,191 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:34,191 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:34,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:34,191 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:34,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:34,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:34,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,192 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:34,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,193 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:34,194 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,194 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,196 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:34,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 17:02:34,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:34,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:34,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:34,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-17 17:02:34,197 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:34,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:34,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:34,197 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:34,197 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:34,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:34,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:34,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:02:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:34,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:34,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:34,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:34,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,199 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:34,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:34,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309175f2487feabaf4063a869fee41236cb58, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309175416a09782f84a7fb227be576e141843] mob files 2023-09-17 17:02:34,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309175f2487feabaf4063a869fee41236cb58 2023-09-17 17:02:34,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309175416a09782f84a7fb227be576e141843 2023-09-17 17:02:34,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-17 17:02:34,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,239 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694970154094Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694970154215 (+121 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694970154215Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694970154215Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694970154219 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694970154230 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694970154238 (+8 ms) 2023-09-17 17:02:34,244 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 17:02:34,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 149 msec 2023-09-17 17:02:34,399 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:34,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 17:02:34,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:02:34,400 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400 2023-09-17 17:02:34,400 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35449, tgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400, rawTgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400, srcFsUri=hdfs://localhost:35449, srcDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:02:34,422 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:02:34,422 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1887246398_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,422 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3, snapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-17 17:02:34,427 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:34,448 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:34,448 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:34,449 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:34,449 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,321 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-2077755281892913326.jar 2023-09-17 17:02:35,322 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,322 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,389 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-6495587353874545080.jar 2023-09-17 17:02:35,389 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,390 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,390 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,390 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,391 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,391 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:35,391 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 17:02:35,392 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 17:02:35,392 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 17:02:35,392 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 17:02:35,392 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 17:02:35,393 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 17:02:35,393 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 17:02:35,394 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 17:02:35,394 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 17:02:35,394 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 17:02:35,395 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:35,395 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:35,396 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:35,396 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:35,396 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:35,397 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:35,397 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:35,744 WARN [Listener at jenkins-hbase4.apache.org/42231] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 17:02:35,746 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-17 17:02:36,877 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:02:36,877 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:02:36,880 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0005_000001 (auth:SIMPLE) 2023-09-17 17:02:37,588 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0006_000001 (auth:SIMPLE) 2023-09-17 17:02:37,943 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 17:02:41,241 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0006_000001 (auth:SIMPLE) 2023-09-17 17:02:44,080 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 17:02:44,080 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 17:02:44,086 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:44,086 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 17:02:44,086 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 17:02:44,087 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:44,087 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-17 17:02:44,087 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-17 17:02:44,087 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:44,088 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-17 17:02:44,088 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970154400/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-17 17:02:44,093 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-17 17:02:44,098 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970164098"}]},"ts":"1694970164098"} 2023-09-17 17:02:44,099 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-17 17:02:44,100 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-17 17:02:44,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b5193e09f72a27db4e379a379286f06, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=816fc22edae4e82ccf4a823c85ba9b8e, UNASSIGN}] 2023-09-17 17:02:44,103 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b5193e09f72a27db4e379a379286f06, UNASSIGN 2023-09-17 17:02:44,103 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=816fc22edae4e82ccf4a823c85ba9b8e, UNASSIGN 2023-09-17 17:02:44,104 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5b5193e09f72a27db4e379a379286f06, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:44,104 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970164104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970164104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970164104"}]},"ts":"1694970164104"} 2023-09-17 17:02:44,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=816fc22edae4e82ccf4a823c85ba9b8e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:44,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970164104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970164104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970164104"}]},"ts":"1694970164104"} 2023-09-17 17:02:44,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 5b5193e09f72a27db4e379a379286f06, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:02:44,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 816fc22edae4e82ccf4a823c85ba9b8e, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:44,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-17 17:02:44,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:44,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b5193e09f72a27db4e379a379286f06, disabling compactions & flushes 2023-09-17 17:02:44,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:44,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:44,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. after waiting 0 ms 2023-09-17 17:02:44,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:44,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:44,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 816fc22edae4e82ccf4a823c85ba9b8e, disabling compactions & flushes 2023-09-17 17:02:44,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:44,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:44,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. after waiting 0 ms 2023-09-17 17:02:44,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:44,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:02:44,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:44,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:02:44,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06. 2023-09-17 17:02:44,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b5193e09f72a27db4e379a379286f06: 2023-09-17 17:02:44,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:44,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e. 2023-09-17 17:02:44,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 816fc22edae4e82ccf4a823c85ba9b8e: 2023-09-17 17:02:44,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:44,271 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5b5193e09f72a27db4e379a379286f06, regionState=CLOSED 2023-09-17 17:02:44,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:44,271 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970164271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970164271"}]},"ts":"1694970164271"} 2023-09-17 17:02:44,272 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=816fc22edae4e82ccf4a823c85ba9b8e, regionState=CLOSED 2023-09-17 17:02:44,272 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694970164272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970164272"}]},"ts":"1694970164272"} 2023-09-17 17:02:44,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-17 17:02:44,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 5b5193e09f72a27db4e379a379286f06, server=jenkins-hbase4.apache.org,35553,1694970066217 in 168 msec 2023-09-17 17:02:44,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-17 17:02:44,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 816fc22edae4e82ccf4a823c85ba9b8e, server=jenkins-hbase4.apache.org,42773,1694970066257 in 168 msec 2023-09-17 17:02:44,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b5193e09f72a27db4e379a379286f06, UNASSIGN in 174 msec 2023-09-17 17:02:44,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-17 17:02:44,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=816fc22edae4e82ccf4a823c85ba9b8e, UNASSIGN in 174 msec 2023-09-17 17:02:44,277 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970164277"}]},"ts":"1694970164277"} 2023-09-17 17:02:44,278 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-17 17:02:44,280 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-17 17:02:44,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-09-17 17:02:44,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-17 17:02:44,400 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-17 17:02:44,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,404 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,404 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,406 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,408 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:44,408 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:44,410 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,410 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,410 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,410 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-17 17:02:44,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-17 17:02:44,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-17 17:02:44,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-17 17:02:44,411 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/recovered.edits] 2023-09-17 17:02:44,411 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/recovered.edits] 2023-09-17 17:02:44,411 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,411 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,411 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:44,411 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,412 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:44,411 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:44,411 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,412 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:44,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-17 17:02:44,415 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf/3e85a54af53e4510a8897e68e51d2e9c to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/cf/3e85a54af53e4510a8897e68e51d2e9c 2023-09-17 17:02:44,415 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf/a37d12a589584ec6ab13504ea54e3a60 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/cf/a37d12a589584ec6ab13504ea54e3a60 2023-09-17 17:02:44,418 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06/recovered.edits/9.seqid 2023-09-17 17:02:44,418 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e/recovered.edits/9.seqid 2023-09-17 17:02:44,418 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b5193e09f72a27db4e379a379286f06 2023-09-17 17:02:44,418 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testEmptyExportFileSystemState/816fc22edae4e82ccf4a823c85ba9b8e 2023-09-17 17:02:44,418 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-17 17:02:44,419 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-17 17:02:44,420 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-17 17:02:44,422 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309175f2487feabaf4063a869fee41236cb58 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309175f2487feabaf4063a869fee41236cb58 2023-09-17 17:02:44,424 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309175416a09782f84a7fb227be576e141843 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309175416a09782f84a7fb227be576e141843 2023-09-17 17:02:44,424 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-17 17:02:44,426 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,428 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-17 17:02:44,429 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-17 17:02:44,430 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,430 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-17 17:02:44,430 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970164430"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:44,431 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970164430"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:44,432 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 17:02:44,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b5193e09f72a27db4e379a379286f06, NAME => 'testtb-testEmptyExportFileSystemState,,1694970153089.5b5193e09f72a27db4e379a379286f06.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 816fc22edae4e82ccf4a823c85ba9b8e, NAME => 'testtb-testEmptyExportFileSystemState,1,1694970153089.816fc22edae4e82ccf4a823c85ba9b8e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 17:02:44,432 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-17 17:02:44,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694970164432"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:44,433 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-17 17:02:44,435 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 17:02:44,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-09-17 17:02:44,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-17 17:02:44,514 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-17 17:02:44,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-17 17:02:44,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:44,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-17 17:02:44,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-17 17:02:44,548 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 758) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:39553 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4609 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-339620575_1 at /127.0.0.1:33604 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:53290 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:55252 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-339620575_1 at /127.0.0.1:53264 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2120557607_17 at /127.0.0.1:33622 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:33879 from appattempt_1694970072498_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:34211 from appattempt_1694970072498_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62e3c99e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 198) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=9090 (was 9170) 2023-09-17 17:02:44,548 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-17 17:02:44,567 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=168, AvailableMemoryMB=9090 2023-09-17 17:02:44,567 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-17 17:02:44,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 17:02:44,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:44,571 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 17:02:44,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-17 17:02:44,572 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 17:02:44,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-17 17:02:44,574 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,574 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,574 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0 empty. 2023-09-17 17:02:44,575 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b empty. 2023-09-17 17:02:44,575 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,575 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,575 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-17 17:02:44,588 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-17 17:02:44,589 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 63aceedbfc16c8da257187e3daad15a0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:02:44,589 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 42e69346d382f41f95d895d98f2b620b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp 2023-09-17 17:02:44,613 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:44,613 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 63aceedbfc16c8da257187e3daad15a0, disabling compactions & flushes 2023-09-17 17:02:44,613 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:44,613 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:44,613 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. after waiting 0 ms 2023-09-17 17:02:44,613 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:44,613 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:44,613 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 63aceedbfc16c8da257187e3daad15a0: 2023-09-17 17:02:44,616 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:44,616 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 42e69346d382f41f95d895d98f2b620b, disabling compactions & flushes 2023-09-17 17:02:44,616 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:44,616 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:44,616 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. after waiting 0 ms 2023-09-17 17:02:44,617 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:44,617 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:44,617 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 42e69346d382f41f95d895d98f2b620b: 2023-09-17 17:02:44,619 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 17:02:44,620 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970164620"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970164620"}]},"ts":"1694970164620"} 2023-09-17 17:02:44,620 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970164620"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970164620"}]},"ts":"1694970164620"} 2023-09-17 17:02:44,622 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 17:02:44,623 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 17:02:44,623 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970164623"}]},"ts":"1694970164623"} 2023-09-17 17:02:44,624 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-17 17:02:44,628 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 17:02:44,629 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 17:02:44,629 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 17:02:44,629 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 17:02:44,629 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 17:02:44,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=63aceedbfc16c8da257187e3daad15a0, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e69346d382f41f95d895d98f2b620b, ASSIGN}] 2023-09-17 17:02:44,631 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e69346d382f41f95d895d98f2b620b, ASSIGN 2023-09-17 17:02:44,632 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=63aceedbfc16c8da257187e3daad15a0, ASSIGN 2023-09-17 17:02:44,632 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=63aceedbfc16c8da257187e3daad15a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35553,1694970066217; forceNewPlan=false, retain=false 2023-09-17 17:02:44,632 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e69346d382f41f95d895d98f2b620b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42773,1694970066257; forceNewPlan=false, retain=false 2023-09-17 17:02:44,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-17 17:02:44,782 INFO [jenkins-hbase4:36669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 17:02:44,785 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=63aceedbfc16c8da257187e3daad15a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:44,785 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=42e69346d382f41f95d895d98f2b620b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:44,785 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970164785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970164785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970164785"}]},"ts":"1694970164785"} 2023-09-17 17:02:44,785 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970164785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970164785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970164785"}]},"ts":"1694970164785"} 2023-09-17 17:02:44,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 63aceedbfc16c8da257187e3daad15a0, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:02:44,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 42e69346d382f41f95d895d98f2b620b, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:44,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-17 17:02:44,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:44,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:44,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42e69346d382f41f95d895d98f2b620b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 17:02:44,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63aceedbfc16c8da257187e3daad15a0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. service=AccessControlService 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. service=AccessControlService 2023-09-17 17:02:44,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:44,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,943 INFO [StoreOpener-63aceedbfc16c8da257187e3daad15a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,943 INFO [StoreOpener-42e69346d382f41f95d895d98f2b620b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,945 DEBUG [StoreOpener-42e69346d382f41f95d895d98f2b620b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf 2023-09-17 17:02:44,945 DEBUG [StoreOpener-63aceedbfc16c8da257187e3daad15a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf 2023-09-17 17:02:44,945 DEBUG [StoreOpener-63aceedbfc16c8da257187e3daad15a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf 2023-09-17 17:02:44,945 DEBUG [StoreOpener-42e69346d382f41f95d895d98f2b620b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf 2023-09-17 17:02:44,945 INFO [StoreOpener-63aceedbfc16c8da257187e3daad15a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63aceedbfc16c8da257187e3daad15a0 columnFamilyName cf 2023-09-17 17:02:44,945 INFO [StoreOpener-42e69346d382f41f95d895d98f2b620b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42e69346d382f41f95d895d98f2b620b columnFamilyName cf 2023-09-17 17:02:44,946 INFO [StoreOpener-42e69346d382f41f95d895d98f2b620b-1] regionserver.HStore(310): Store=42e69346d382f41f95d895d98f2b620b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:44,946 INFO [StoreOpener-63aceedbfc16c8da257187e3daad15a0-1] regionserver.HStore(310): Store=63aceedbfc16c8da257187e3daad15a0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 17:02:44,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:44,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:44,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:02:44,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 17:02:44,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42e69346d382f41f95d895d98f2b620b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75290257, jitterRate=0.12191225588321686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:44,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42e69346d382f41f95d895d98f2b620b: 2023-09-17 17:02:44,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 63aceedbfc16c8da257187e3daad15a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59918358, jitterRate=-0.10714688897132874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 17:02:44,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 63aceedbfc16c8da257187e3daad15a0: 2023-09-17 17:02:44,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b., pid=109, masterSystemTime=1694970164938 2023-09-17 17:02:44,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0., pid=108, masterSystemTime=1694970164938 2023-09-17 17:02:44,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:44,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:44,955 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=42e69346d382f41f95d895d98f2b620b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:44,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:44,955 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970164955"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970164955"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970164955"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970164955"}]},"ts":"1694970164955"} 2023-09-17 17:02:44,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:44,955 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=63aceedbfc16c8da257187e3daad15a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:44,956 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970164955"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694970164955"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694970164955"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694970164955"}]},"ts":"1694970164955"} 2023-09-17 17:02:44,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-17 17:02:44,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 42e69346d382f41f95d895d98f2b620b, server=jenkins-hbase4.apache.org,42773,1694970066257 in 170 msec 2023-09-17 17:02:44,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-17 17:02:44,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 63aceedbfc16c8da257187e3daad15a0, server=jenkins-hbase4.apache.org,35553,1694970066217 in 171 msec 2023-09-17 17:02:44,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e69346d382f41f95d895d98f2b620b, ASSIGN in 330 msec 2023-09-17 17:02:44,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-17 17:02:44,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=63aceedbfc16c8da257187e3daad15a0, ASSIGN in 330 msec 2023-09-17 17:02:44,961 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 17:02:44,961 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970164961"}]},"ts":"1694970164961"} 2023-09-17 17:02:44,962 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-17 17:02:44,964 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 17:02:44,965 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-17 17:02:44,966 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-17 17:02:44,967 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:44,967 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:44,967 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:44,967 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:44,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:44,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:44,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:44,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-17 17:02:44,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 401 msec 2023-09-17 17:02:45,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-17 17:02:45,175 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-17 17:02:45,178 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,178 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:45,180 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:02:45,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 17:02:45,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970165191 (current time:1694970165191). 2023-09-17 17:02:45,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:02:45,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x601a4b33 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:45,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@141c093, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:45,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:45,201 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:45,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x601a4b33 to 127.0.0.1:59728 2023-09-17 17:02:45,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:45,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x6bae75b0 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:45,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@595ff825, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:45,209 DEBUG [hconnection-0x5615eec5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:45,211 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:45,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bae75b0 to 127.0.0.1:59728 2023-09-17 17:02:45,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:45,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-17 17:02:45,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:02:45,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 17:02:45,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 17:02:45,218 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 17:02:45,219 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694970765219 2023-09-17 17:02:45,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 17:02:45,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,221 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 17:02:45,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 17:02:45,221 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:02:45,221 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:02:45,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-17 17:02:45,222 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 17:02:45,223 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694970765223 2023-09-17 17:02:45,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,231 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-17 17:02:45,231 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:45,232 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-17 17:02:45,232 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-17 17:02:45,232 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,232 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,234 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,234 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,234 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,234 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,235 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,235 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,235 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,235 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:02:45,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 17:02:45,236 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 17:02:45,236 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,237 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 17:02:45,237 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 17:02:45,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,237 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 17:02:45,237 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 17:02:45,237 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 17:02:45,237 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 17:02:45,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 17:02:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 17:02:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 17:02:45,239 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 17:02:45,239 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 17:02:45,239 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 17:02:45,246 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,246 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,247 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:45,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-17 17:02:45,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@393a1348[Count = 1] remaining members to acquire global barrier 2023-09-17 17:02:45,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-17 17:02:45,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@393a1348[Count = 0] remaining members to acquire global barrier 2023-09-17 17:02:45,250 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-17 17:02:45,250 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,251 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,251 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,251 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,252 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 17:02:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:45,252 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:45,252 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,252 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 17:02:45,252 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 17:02:45,252 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. started... 2023-09-17 17:02:45,252 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. started... 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:45,253 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42e69346d382f41f95d895d98f2b620b: 2023-09-17 17:02:45,252 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 63aceedbfc16c8da257187e3daad15a0: 2023-09-17 17:02:45,252 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:02:45,253 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,253 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,254 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:45,254 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:45,254 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:02:45,254 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 17:02:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 17:02:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 17:02:45,267 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. completed. 2023-09-17 17:02:45,267 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:45,267 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:45,267 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:45,267 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,267 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 17:02:45,267 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:02:45,268 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. completed. 2023-09-17 17:02:45,268 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 17:02:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:02:45,269 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,269 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 17:02:45,269 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:45,269 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 17:02:45,270 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 17:02:45,271 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:45,271 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 17:02:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,271 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:02:45,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-17 17:02:45,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:02:45,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-17 17:02:45,277 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-17 17:02:45,277 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:02:45,277 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:02:45,277 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,277 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:02:45,279 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,279 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,280 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,280 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,282 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,282 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,282 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,286 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,286 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,286 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,286 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:45,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,287 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,286 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,287 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,286 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,287 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,288 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 17:02:45,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,315 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-17 17:02:45,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,316 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694970165219Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694970165295 (+76 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694970165295Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694970165295Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694970165298 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694970165309 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694970165315 (+6 ms) 2023-09-17 17:02:45,318 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 17:02:45,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 99 msec 2023-09-17 17:02:45,321 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:45,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-17 17:02:45,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:02:45,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35553] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:02:45,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 17:02:45,328 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,328 DEBUG [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:45,329 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 17:02:45,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 17:02:45,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694970165338 (current time:1694970165338). 2023-09-17 17:02:45,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 17:02:45,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x4b104ad9 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:45,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@328ae6b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:45,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:45,350 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:45,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b104ad9 to 127.0.0.1:59728 2023-09-17 17:02:45,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:45,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(139): Connect 0x7591c761 to 127.0.0.1:59728 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 17:02:45,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1e1d88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 17:02:45,358 DEBUG [hconnection-0x59448395-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 17:02:45,359 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 17:02:45,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7591c761 to 127.0.0.1:59728 2023-09-17 17:02:45,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:02:45,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-17 17:02:45,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 17:02:45,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 17:02:45,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 17:02:45,367 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 17:02:45,368 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694970765368 2023-09-17 17:02:45,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 17:02:45,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,369 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 17:02:45,369 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 17:02:45,370 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 17:02:45,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 17:02:45,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-17 17:02:45,372 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 17:02:45,372 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694970765372 2023-09-17 17:02:45,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,383 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-17 17:02:45,383 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:45,384 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-17 17:02:45,384 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-17 17:02:45,384 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,384 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,386 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,386 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,386 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,386 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,386 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,386 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,386 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,387 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 17:02:45,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 17:02:45,387 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 17:02:45,387 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:45,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 17:02:45,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,389 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 17:02:45,389 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 17:02:45,389 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:45,389 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 17:02:45,389 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 17:02:45,389 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 17:02:45,390 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 17:02:45,390 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 17:02:45,390 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 17:02:45,389 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 17:02:45,390 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 17:02:45,391 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46223,1694970066168' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 17:02:45,392 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,392 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,392 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,392 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:45,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 17:02:45,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42773,1694970066257' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@634e02ed[Count = 1] remaining members to acquire global barrier 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35553,1694970066217' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-17 17:02:45,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@634e02ed[Count = 0] remaining members to acquire global barrier 2023-09-17 17:02:45,397 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-17 17:02:45,397 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 17:02:45,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,402 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:45,403 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:45,403 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:45,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,403 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. started... 2023-09-17 17:02:45,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,402 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 17:02:45,403 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,403 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 17:02:45,403 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 17:02:45,403 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 17:02:45,403 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42e69346d382f41f95d895d98f2b620b 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-17 17:02:45,403 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46223,1694970066168' in zk 2023-09-17 17:02:45,403 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 17:02:45,403 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 17:02:45,403 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:45,403 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. started... 2023-09-17 17:02:45,403 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 63aceedbfc16c8da257187e3daad15a0 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-17 17:02:45,404 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 17:02:45,404 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:45,405 DEBUG [member: 'jenkins-hbase4.apache.org,46223,1694970066168' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 17:02:45,422 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917556fa3c9a2314eb7a7c41e1efe8bb311 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917556fa3c9a2314eb7a7c41e1efe8bb311 2023-09-17 17:02:45,427 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230917dbdb0a20215d4a5b986d9d6f136270f2 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917dbdb0a20215d4a5b986d9d6f136270f2 2023-09-17 17:02:45,439 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/.tmp/cf/a3ca88b0bc8141b5a9ca9c3bc37582d4 2023-09-17 17:02:45,442 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/.tmp/cf/56a5e541f519475a881f2dc272cb278d 2023-09-17 17:02:45,445 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/.tmp/cf/a3ca88b0bc8141b5a9ca9c3bc37582d4 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf/a3ca88b0bc8141b5a9ca9c3bc37582d4 2023-09-17 17:02:45,446 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/.tmp/cf/56a5e541f519475a881f2dc272cb278d as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf/56a5e541f519475a881f2dc272cb278d 2023-09-17 17:02:45,449 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf/a3ca88b0bc8141b5a9ca9c3bc37582d4, entries=5, sequenceid=6, filesize=5.8 K 2023-09-17 17:02:45,450 INFO [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 63aceedbfc16c8da257187e3daad15a0 in 47ms, sequenceid=6, compaction requested=false 2023-09-17 17:02:45,450 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-17 17:02:45,450 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf/56a5e541f519475a881f2dc272cb278d, entries=45, sequenceid=6, filesize=13.0 K 2023-09-17 17:02:45,450 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 63aceedbfc16c8da257187e3daad15a0: 2023-09-17 17:02:45,451 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,451 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:45,451 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf/a3ca88b0bc8141b5a9ca9c3bc37582d4] hfiles 2023-09-17 17:02:45,451 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf/a3ca88b0bc8141b5a9ca9c3bc37582d4 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,451 INFO [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 42e69346d382f41f95d895d98f2b620b in 48ms, sequenceid=6, compaction requested=false 2023-09-17 17:02:45,453 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42e69346d382f41f95d895d98f2b620b: 2023-09-17 17:02:45,453 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,453 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 17:02:45,453 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf/56a5e541f519475a881f2dc272cb278d] hfiles 2023-09-17 17:02:45,453 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf/56a5e541f519475a881f2dc272cb278d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,462 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. completed. 2023-09-17 17:02:45,463 DEBUG [rs(jenkins-hbase4.apache.org,35553,1694970066217)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35553,1694970066217' in zk 2023-09-17 17:02:45,463 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. completed. 2023-09-17 17:02:45,463 DEBUG [rs(jenkins-hbase4.apache.org,42773,1694970066257)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 17:02:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42773,1694970066257' in zk 2023-09-17 17:02:45,464 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 17:02:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,465 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:45,465 DEBUG [member: 'jenkins-hbase4.apache.org,35553,1694970066217' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 17:02:45,466 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,466 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 17:02:45,466 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,466 DEBUG [member: 'jenkins-hbase4.apache.org,42773,1694970066257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 17:02:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,469 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35553,1694970066217': 2023-09-17 17:02:45,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35553,1694970066217' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-17 17:02:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-17 17:02:45,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-17 17:02:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,470 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 17:02:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42773,1694970066257': 2023-09-17 17:02:45,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42773,1694970066257' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-17 17:02:45,473 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-17 17:02:45,473 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 17:02:45,473 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 17:02:45,473 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,474 INFO [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 17:02:45,477 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,477 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,477 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 17:02:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 17:02:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,477 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 17:02:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,478 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,478 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 17:02:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 17:02:45,480 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,480 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,480 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 17:02:45,483 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,483 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 17:02:45,483 DEBUG [(jenkins-hbase4.apache.org,36669,1694970064919)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 17:02:45,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:45,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,483 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 17:02:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,485 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 17:02:45,485 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:02:45,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 17:02:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 17:02:45,485 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:45,485 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,486 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917dbdb0a20215d4a5b986d9d6f136270f2, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917556fa3c9a2314eb7a7c41e1efe8bb311] mob files 2023-09-17 17:02:45,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917dbdb0a20215d4a5b986d9d6f136270f2 2023-09-17 17:02:45,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917556fa3c9a2314eb7a7c41e1efe8bb311 2023-09-17 17:02:45,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-17 17:02:45,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,510 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694970165368Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694970165492 (+124 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694970165492Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694970165492Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694970165495 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694970165501 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694970165509 (+8 ms) 2023-09-17 17:02:45,512 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 17:02:45,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 143 msec 2023-09-17 17:02:45,671 DEBUG [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 17:02:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-17 17:02:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 17:02:45,672 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672 2023-09-17 17:02:45,672 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35449, tgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672, rawTgtDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672, srcFsUri=hdfs://localhost:35449, srcDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:02:45,694 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3 2023-09-17 17:02:45,694 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-779371907_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,694 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35449, inputRoot=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3, snapshotDir=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-17 17:02:45,702 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:45,717 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:45,717 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:45,718 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:45,718 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,594 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-2981066806870693357.jar 2023-09-17 17:02:46,595 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,595 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,661 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/hadoop-6756495988257560386.jar 2023-09-17 17:02:46,662 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,662 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,662 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,663 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,663 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,663 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 17:02:46,664 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 17:02:46,664 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 17:02:46,664 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 17:02:46,665 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 17:02:46,665 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 17:02:46,665 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 17:02:46,666 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 17:02:46,666 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 17:02:46,666 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 17:02:46,667 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 17:02:46,667 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:46,668 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:46,668 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:46,668 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:46,669 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 17:02:46,669 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:46,670 DEBUG [Listener at jenkins-hbase4.apache.org/42231] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 17:02:46,996 WARN [Listener at jenkins-hbase4.apache.org/42231] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 17:02:46,998 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-17 17:02:46,999 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-17 17:02:48,539 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:02:48,539 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 17:02:48,541 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0006_000001 (auth:SIMPLE) 2023-09-17 17:02:48,890 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0007_000001 (auth:SIMPLE) 2023-09-17 17:02:49,864 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 17:02:52,540 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0007_000001 (auth:SIMPLE) 2023-09-17 17:02:54,741 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0007_000001 (auth:SIMPLE) 2023-09-17 17:02:57,230 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0007_000001 (auth:SIMPLE) 2023-09-17 17:02:59,147 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 17:02:59,147 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 17:02:59,157 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,157 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 17:02:59,158 INFO [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 17:02:59,158 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,158 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-17 17:02:59,158 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-17 17:02:59,158 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2120557607_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,159 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-17 17:02:59,159 DEBUG [Listener at jenkins-hbase4.apache.org/42231] snapshot.TestExportSnapshot(367): hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/export-test/export-1694970165672/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-17 17:02:59,164 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-17 17:02:59,168 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970179168"}]},"ts":"1694970179168"} 2023-09-17 17:02:59,169 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-17 17:02:59,171 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-17 17:02:59,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=63aceedbfc16c8da257187e3daad15a0, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e69346d382f41f95d895d98f2b620b, UNASSIGN}] 2023-09-17 17:02:59,173 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=63aceedbfc16c8da257187e3daad15a0, UNASSIGN 2023-09-17 17:02:59,173 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e69346d382f41f95d895d98f2b620b, UNASSIGN 2023-09-17 17:02:59,174 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=63aceedbfc16c8da257187e3daad15a0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:02:59,174 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=42e69346d382f41f95d895d98f2b620b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:02:59,174 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970179174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970179174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970179174"}]},"ts":"1694970179174"} 2023-09-17 17:02:59,174 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970179174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694970179174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694970179174"}]},"ts":"1694970179174"} 2023-09-17 17:02:59,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 63aceedbfc16c8da257187e3daad15a0, server=jenkins-hbase4.apache.org,35553,1694970066217}] 2023-09-17 17:02:59,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 42e69346d382f41f95d895d98f2b620b, server=jenkins-hbase4.apache.org,42773,1694970066257}] 2023-09-17 17:02:59,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-17 17:02:59,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:59,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42e69346d382f41f95d895d98f2b620b, disabling compactions & flushes 2023-09-17 17:02:59,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:59,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. after waiting 0 ms 2023-09-17 17:02:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 63aceedbfc16c8da257187e3daad15a0, disabling compactions & flushes 2023-09-17 17:02:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:59,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. after waiting 0 ms 2023-09-17 17:02:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:59,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:02:59,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:02:59,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:59,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:02:59,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0. 2023-09-17 17:02:59,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 63aceedbfc16c8da257187e3daad15a0: 2023-09-17 17:02:59,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b. 2023-09-17 17:02:59,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42e69346d382f41f95d895d98f2b620b: 2023-09-17 17:02:59,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:59,342 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=63aceedbfc16c8da257187e3daad15a0, regionState=CLOSED 2023-09-17 17:02:59,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970179342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970179342"}]},"ts":"1694970179342"} 2023-09-17 17:02:59,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:59,342 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=42e69346d382f41f95d895d98f2b620b, regionState=CLOSED 2023-09-17 17:02:59,342 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694970179342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694970179342"}]},"ts":"1694970179342"} 2023-09-17 17:02:59,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-17 17:02:59,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 63aceedbfc16c8da257187e3daad15a0, server=jenkins-hbase4.apache.org,35553,1694970066217 in 168 msec 2023-09-17 17:02:59,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-17 17:02:59,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 42e69346d382f41f95d895d98f2b620b, server=jenkins-hbase4.apache.org,42773,1694970066257 in 168 msec 2023-09-17 17:02:59,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=63aceedbfc16c8da257187e3daad15a0, UNASSIGN in 173 msec 2023-09-17 17:02:59,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-17 17:02:59,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e69346d382f41f95d895d98f2b620b, UNASSIGN in 173 msec 2023-09-17 17:02:59,347 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694970179347"}]},"ts":"1694970179347"} 2023-09-17 17:02:59,348 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-17 17:02:59,350 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-17 17:02:59,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 185 msec 2023-09-17 17:02:59,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-17 17:02:59,470 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-17 17:02:59,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,474 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,475 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,476 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,479 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:59,479 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:59,480 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,480 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,480 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,480 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-17 17:02:59,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-17 17:02:59,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-17 17:02:59,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-17 17:02:59,481 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/recovered.edits] 2023-09-17 17:02:59,481 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,481 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,481 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf, FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/recovered.edits] 2023-09-17 17:02:59,481 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:59,481 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,481 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,481 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:59,482 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:59,482 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 17:02:59,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-17 17:02:59,485 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf/a3ca88b0bc8141b5a9ca9c3bc37582d4 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/cf/a3ca88b0bc8141b5a9ca9c3bc37582d4 2023-09-17 17:02:59,485 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf/56a5e541f519475a881f2dc272cb278d to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/cf/56a5e541f519475a881f2dc272cb278d 2023-09-17 17:02:59,488 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0/recovered.edits/9.seqid 2023-09-17 17:02:59,488 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/recovered.edits/9.seqid to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b/recovered.edits/9.seqid 2023-09-17 17:02:59,489 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/63aceedbfc16c8da257187e3daad15a0 2023-09-17 17:02:59,489 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e69346d382f41f95d895d98f2b620b 2023-09-17 17:02:59,489 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-17 17:02:59,489 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-17 17:02:59,490 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-17 17:02:59,493 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917dbdb0a20215d4a5b986d9d6f136270f2 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917dbdb0a20215d4a5b986d9d6f136270f2 2023-09-17 17:02:59,494 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917556fa3c9a2314eb7a7c41e1efe8bb311 to hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917556fa3c9a2314eb7a7c41e1efe8bb311 2023-09-17 17:02:59,495 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-17 17:02:59,497 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,499 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-17 17:02:59,500 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-17 17:02:59,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-17 17:02:59,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970179501"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:59,502 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694970179501"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:59,503 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 17:02:59,503 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 63aceedbfc16c8da257187e3daad15a0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694970164568.63aceedbfc16c8da257187e3daad15a0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 42e69346d382f41f95d895d98f2b620b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694970164568.42e69346d382f41f95d895d98f2b620b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 17:02:59,503 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-17 17:02:59,503 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694970179503"}]},"ts":"9223372036854775807"} 2023-09-17 17:02:59,505 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-17 17:02:59,506 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-09-17 17:02:59,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-17 17:02:59,584 INFO [Listener at jenkins-hbase4.apache.org/42231] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-17 17:02:59,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-17 17:02:59,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-17 17:02:59,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 17:02:59,618 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 764), OpenFileDescriptor=905 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=215 (was 199) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=9019 (was 9090) 2023-09-17 17:02:59,618 WARN [Listener at jenkins-hbase4.apache.org/42231] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-17 17:02:59,618 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-17 17:02:59,630 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-17 17:03:03,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694970072498_0007_000001 (auth:SIMPLE) 2023-09-17 17:03:04,908 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 17:03:13,755 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-17 17:03:27,872 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-17 17:03:27,873 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-17 17:03:27,981 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-17 17:03:27,991 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-17 17:03:27,992 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-17 17:03:28,001 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-17 17:03:28,105 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-17 17:03:28,105 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-17 17:03:28,105 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-17 17:03:28,105 INFO [Listener at jenkins-hbase4.apache.org/42231] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-17 17:03:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/42231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cba4ac7 to 127.0.0.1:59728 2023-09-17 17:03:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/42231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/42231] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-17 17:03:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/42231] util.JVMClusterUtil(257): Found active master hash=1178370836, stopped=false 2023-09-17 17:03:28,106 DEBUG [Listener at jenkins-hbase4.apache.org/42231] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:03:28,106 DEBUG [Listener at jenkins-hbase4.apache.org/42231] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-17 17:03:28,106 INFO [Listener at jenkins-hbase4.apache.org/42231] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:03:28,107 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-17 17:03:28,107 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-17 17:03:28,107 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-17 17:03:28,107 INFO [Listener at jenkins-hbase4.apache.org/42231] procedure2.ProcedureExecutor(628): Stopping 2023-09-17 17:03:28,107 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-17 17:03:28,107 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:03:28,107 DEBUG [Listener at jenkins-hbase4.apache.org/42231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4722c790 to 127.0.0.1:59728 2023-09-17 17:03:28,108 DEBUG [Listener at jenkins-hbase4.apache.org/42231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 17:03:28,108 INFO [Listener at jenkins-hbase4.apache.org/42231] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46223,1694970066168' ***** 2023-09-17 17:03:28,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 17:03:28,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 17:03:28,108 DEBUG [Listener at jenkins-hbase4.apache.org/42231] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:03:28,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 17:03:28,108 INFO [Listener at jenkins-hbase4.apache.org/42231] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-17 17:03:28,108 INFO [Listener at jenkins-hbase4.apache.org/42231] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35553,1694970066217' ***** 2023-09-17 17:03:28,108 DEBUG [Listener at jenkins-hbase4.apache.org/42231] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:03:28,108 INFO [Listener at jenkins-hbase4.apache.org/42231] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-17 17:03:28,108 INFO [RS:0;jenkins-hbase4:46223] regionserver.HeapMemoryManager(220): Stopping 2023-09-17 17:03:28,108 INFO [Listener at jenkins-hbase4.apache.org/42231] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42773,1694970066257' ***** 2023-09-17 17:03:28,109 INFO [RS:1;jenkins-hbase4:35553] regionserver.HeapMemoryManager(220): Stopping 2023-09-17 17:03:28,109 DEBUG [Listener at jenkins-hbase4.apache.org/42231] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:03:28,109 INFO [RS:0;jenkins-hbase4:46223] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-17 17:03:28,109 INFO [Listener at jenkins-hbase4.apache.org/42231] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-17 17:03:28,109 INFO [RS:0;jenkins-hbase4:46223] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-17 17:03:28,109 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-17 17:03:28,109 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-17 17:03:28,109 INFO [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:03:28,109 INFO [RS:1;jenkins-hbase4:35553] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-17 17:03:28,109 DEBUG [RS:0;jenkins-hbase4:46223] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ec81448 to 127.0.0.1:59728 2023-09-17 17:03:28,109 INFO [RS:2;jenkins-hbase4:42773] regionserver.HeapMemoryManager(220): Stopping 2023-09-17 17:03:28,109 DEBUG [RS:0;jenkins-hbase4:46223] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,109 INFO [RS:2;jenkins-hbase4:42773] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-17 17:03:28,109 INFO [RS:1;jenkins-hbase4:35553] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-17 17:03:28,111 INFO [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46223,1694970066168; all regions closed. 2023-09-17 17:03:28,111 INFO [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:03:28,110 INFO [RS:2;jenkins-hbase4:42773] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-17 17:03:28,109 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-17 17:03:28,111 DEBUG [RS:1;jenkins-hbase4:35553] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x309db57c to 127.0.0.1:59728 2023-09-17 17:03:28,111 DEBUG [RS:1;jenkins-hbase4:35553] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,111 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(3305): Received CLOSE for cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:03:28,113 INFO [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35553,1694970066217; all regions closed. 2023-09-17 17:03:28,113 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(3305): Received CLOSE for 8f4cb51102119deb8a61e23c5d530fce 2023-09-17 17:03:28,113 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:03:28,113 DEBUG [RS:2;jenkins-hbase4:42773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29c90dff to 127.0.0.1:59728 2023-09-17 17:03:28,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc55925ee55e1bfc7af2c533e3eb221d, disabling compactions & flushes 2023-09-17 17:03:28,114 DEBUG [RS:2;jenkins-hbase4:42773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:03:28,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:03:28,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. after waiting 0 ms 2023-09-17 17:03:28,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:03:28,114 INFO [RS:2;jenkins-hbase4:42773] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-17 17:03:28,114 INFO [RS:2;jenkins-hbase4:42773] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-17 17:03:28,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cc55925ee55e1bfc7af2c533e3eb221d 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-17 17:03:28,114 INFO [RS:2;jenkins-hbase4:42773] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-17 17:03:28,114 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-17 17:03:28,115 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-09-17 17:03:28,115 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1478): Online Regions={cc55925ee55e1bfc7af2c533e3eb221d=hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d., 8f4cb51102119deb8a61e23c5d530fce=hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce., 1588230740=hbase:meta,,1.1588230740} 2023-09-17 17:03:28,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-17 17:03:28,115 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-17 17:03:28,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-17 17:03:28,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-17 17:03:28,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-17 17:03:28,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-17 17:03:28,116 DEBUG [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1504): Waiting on 1588230740, 8f4cb51102119deb8a61e23c5d530fce, cc55925ee55e1bfc7af2c533e3eb221d 2023-09-17 17:03:28,128 DEBUG [RS:0;jenkins-hbase4:46223] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/oldWALs 2023-09-17 17:03:28,128 DEBUG [RS:1;jenkins-hbase4:35553] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/oldWALs 2023-09-17 17:03:28,128 INFO [RS:0;jenkins-hbase4:46223] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46223%2C1694970066168:(num 1694970067904) 2023-09-17 17:03:28,128 INFO [RS:1;jenkins-hbase4:35553] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35553%2C1694970066217:(num 1694970067904) 2023-09-17 17:03:28,128 DEBUG [RS:1;jenkins-hbase4:35553] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,128 DEBUG [RS:0;jenkins-hbase4:46223] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,128 INFO [RS:1;jenkins-hbase4:35553] regionserver.LeaseManager(133): Closed leases 2023-09-17 17:03:28,128 INFO [RS:0;jenkins-hbase4:46223] regionserver.LeaseManager(133): Closed leases 2023-09-17 17:03:28,137 INFO [RS:0;jenkins-hbase4:46223] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-17 17:03:28,137 INFO [RS:1;jenkins-hbase4:35553] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-17 17:03:28,138 INFO [RS:1;jenkins-hbase4:35553] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-17 17:03:28,138 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-17 17:03:28,138 INFO [RS:1;jenkins-hbase4:35553] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-17 17:03:28,138 INFO [RS:0;jenkins-hbase4:46223] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-17 17:03:28,138 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-17 17:03:28,138 INFO [RS:0;jenkins-hbase4:46223] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-17 17:03:28,138 INFO [RS:0;jenkins-hbase4:46223] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-17 17:03:28,138 INFO [RS:1;jenkins-hbase4:35553] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-17 17:03:28,139 INFO [RS:1;jenkins-hbase4:35553] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35553 2023-09-17 17:03:28,140 INFO [RS:0;jenkins-hbase4:46223] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46223 2023-09-17 17:03:28,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d/.tmp/info/16737025e1444c7da1acc16583835a6e 2023-09-17 17:03:28,147 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:03:28,147 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 17:03:28,147 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 17:03:28,147 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:03:28,147 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 17:03:28,147 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46223,1694970066168 2023-09-17 17:03:28,147 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 17:03:28,148 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:03:28,148 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:03:28,148 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35553,1694970066217] 2023-09-17 17:03:28,154 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35553,1694970066217 2023-09-17 17:03:28,154 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35553,1694970066217; numProcessing=1 2023-09-17 17:03:28,158 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35553,1694970066217 already deleted, retry=false 2023-09-17 17:03:28,158 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35553,1694970066217 expired; onlineServers=2 2023-09-17 17:03:28,158 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46223,1694970066168] 2023-09-17 17:03:28,158 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46223,1694970066168; numProcessing=2 2023-09-17 17:03:28,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d/.tmp/info/16737025e1444c7da1acc16583835a6e as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d/info/16737025e1444c7da1acc16583835a6e 2023-09-17 17:03:28,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/.tmp/info/5b158c83cea449399a3879e940bc348c 2023-09-17 17:03:28,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b158c83cea449399a3879e940bc348c 2023-09-17 17:03:28,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d/info/16737025e1444c7da1acc16583835a6e, entries=2, sequenceid=6, filesize=4.8 K 2023-09-17 17:03:28,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cc55925ee55e1bfc7af2c533e3eb221d in 54ms, sequenceid=6, compaction requested=false 2023-09-17 17:03:28,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/namespace/cc55925ee55e1bfc7af2c533e3eb221d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 17:03:28,180 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-17 17:03:28,180 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-17 17:03:28,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:03:28,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:03:28,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc55925ee55e1bfc7af2c533e3eb221d: 2023-09-17 17:03:28,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694970068341.cc55925ee55e1bfc7af2c533e3eb221d. 2023-09-17 17:03:28,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8f4cb51102119deb8a61e23c5d530fce, disabling compactions & flushes 2023-09-17 17:03:28,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:03:28,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:03:28,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. after waiting 0 ms 2023-09-17 17:03:28,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:03:28,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8f4cb51102119deb8a61e23c5d530fce 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-17 17:03:28,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/.tmp/rep_barrier/6430f6dc659e4e5aa68d4674646d4df8 2023-09-17 17:03:28,187 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-17 17:03:28,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6430f6dc659e4e5aa68d4674646d4df8 2023-09-17 17:03:28,215 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/.tmp/table/4cf3fe93173b469cb99ba486589a80a7 2023-09-17 17:03:28,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce/.tmp/l/4d713e331f214ef08301dec5c745c577 2023-09-17 17:03:28,220 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4cf3fe93173b469cb99ba486589a80a7 2023-09-17 17:03:28,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d713e331f214ef08301dec5c745c577 2023-09-17 17:03:28,221 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/.tmp/info/5b158c83cea449399a3879e940bc348c as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/info/5b158c83cea449399a3879e940bc348c 2023-09-17 17:03:28,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce/.tmp/l/4d713e331f214ef08301dec5c745c577 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce/l/4d713e331f214ef08301dec5c745c577 2023-09-17 17:03:28,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d713e331f214ef08301dec5c745c577 2023-09-17 17:03:28,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce/l/4d713e331f214ef08301dec5c745c577, entries=7, sequenceid=18, filesize=5.2 K 2023-09-17 17:03:28,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 8f4cb51102119deb8a61e23c5d530fce in 44ms, sequenceid=18, compaction requested=false 2023-09-17 17:03:28,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b158c83cea449399a3879e940bc348c 2023-09-17 17:03:28,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/info/5b158c83cea449399a3879e940bc348c, entries=48, sequenceid=131, filesize=10.3 K 2023-09-17 17:03:28,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/.tmp/rep_barrier/6430f6dc659e4e5aa68d4674646d4df8 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/rep_barrier/6430f6dc659e4e5aa68d4674646d4df8 2023-09-17 17:03:28,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/acl/8f4cb51102119deb8a61e23c5d530fce/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-17 17:03:28,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:03:28,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:03:28,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8f4cb51102119deb8a61e23c5d530fce: 2023-09-17 17:03:28,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694970069084.8f4cb51102119deb8a61e23c5d530fce. 2023-09-17 17:03:28,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6430f6dc659e4e5aa68d4674646d4df8 2023-09-17 17:03:28,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/rep_barrier/6430f6dc659e4e5aa68d4674646d4df8, entries=13, sequenceid=131, filesize=6.4 K 2023-09-17 17:03:28,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/.tmp/table/4cf3fe93173b469cb99ba486589a80a7 as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/table/4cf3fe93173b469cb99ba486589a80a7 2023-09-17 17:03:28,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4cf3fe93173b469cb99ba486589a80a7 2023-09-17 17:03:28,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/table/4cf3fe93173b469cb99ba486589a80a7, entries=24, sequenceid=131, filesize=6.9 K 2023-09-17 17:03:28,244 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 129ms, sequenceid=131, compaction requested=false 2023-09-17 17:03:28,253 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-17 17:03:28,253 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 17:03:28,253 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-17 17:03:28,254 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-17 17:03:28,254 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-17 17:03:28,254 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-17 17:03:28,257 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 17:03:28,257 INFO [RS:1;jenkins-hbase4:35553] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35553,1694970066217; zookeeper connection closed. 2023-09-17 17:03:28,257 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:35553-0x100bad5e4210002, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 17:03:28,257 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 17:03:28,257 INFO [RS:0;jenkins-hbase4:46223] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46223,1694970066168; zookeeper connection closed. 2023-09-17 17:03:28,257 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:46223-0x100bad5e4210001, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 17:03:28,257 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6dfca63d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6dfca63d 2023-09-17 17:03:28,258 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@44339863] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@44339863 2023-09-17 17:03:28,259 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46223,1694970066168 already deleted, retry=false 2023-09-17 17:03:28,259 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46223,1694970066168 expired; onlineServers=1 2023-09-17 17:03:28,316 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42773,1694970066257; all regions closed. 2023-09-17 17:03:28,322 DEBUG [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/oldWALs 2023-09-17 17:03:28,322 INFO [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42773%2C1694970066257.meta:.meta(num 1694970068028) 2023-09-17 17:03:28,327 DEBUG [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/oldWALs 2023-09-17 17:03:28,327 INFO [RS:2;jenkins-hbase4:42773] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42773%2C1694970066257:(num 1694970067903) 2023-09-17 17:03:28,327 DEBUG [RS:2;jenkins-hbase4:42773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,327 INFO [RS:2;jenkins-hbase4:42773] regionserver.LeaseManager(133): Closed leases 2023-09-17 17:03:28,328 INFO [RS:2;jenkins-hbase4:42773] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-17 17:03:28,328 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-17 17:03:28,329 INFO [RS:2;jenkins-hbase4:42773] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42773 2023-09-17 17:03:28,330 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42773,1694970066257 2023-09-17 17:03:28,330 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 17:03:28,332 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42773,1694970066257] 2023-09-17 17:03:28,332 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42773,1694970066257; numProcessing=3 2023-09-17 17:03:28,333 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42773,1694970066257 already deleted, retry=false 2023-09-17 17:03:28,333 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42773,1694970066257 expired; onlineServers=0 2023-09-17 17:03:28,333 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36669,1694970064919' ***** 2023-09-17 17:03:28,333 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-17 17:03:28,334 DEBUG [M:0;jenkins-hbase4:36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@701892f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-17 17:03:28,334 INFO [M:0;jenkins-hbase4:36669] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36669,1694970064919 2023-09-17 17:03:28,334 INFO [M:0;jenkins-hbase4:36669] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36669,1694970064919; all regions closed. 2023-09-17 17:03:28,334 DEBUG [M:0;jenkins-hbase4:36669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 17:03:28,334 DEBUG [M:0;jenkins-hbase4:36669] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-17 17:03:28,334 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-17 17:03:28,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694970067523] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694970067523,5,FailOnTimeoutGroup] 2023-09-17 17:03:28,334 DEBUG [M:0;jenkins-hbase4:36669] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-17 17:03:28,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694970067523] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694970067523,5,FailOnTimeoutGroup] 2023-09-17 17:03:28,334 INFO [M:0;jenkins-hbase4:36669] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-17 17:03:28,334 INFO [M:0;jenkins-hbase4:36669] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-17 17:03:28,334 INFO [M:0;jenkins-hbase4:36669] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-17 17:03:28,334 DEBUG [M:0;jenkins-hbase4:36669] master.HMaster(1512): Stopping service threads 2023-09-17 17:03:28,334 INFO [M:0;jenkins-hbase4:36669] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-17 17:03:28,335 ERROR [M:0;jenkins-hbase4:36669] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-17 17:03:28,335 INFO [M:0;jenkins-hbase4:36669] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-17 17:03:28,335 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-17 17:03:28,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-17 17:03:28,340 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 17:03:28,340 DEBUG [M:0;jenkins-hbase4:36669] zookeeper.ZKUtil(398): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-17 17:03:28,340 WARN [M:0;jenkins-hbase4:36669] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-17 17:03:28,340 INFO [M:0;jenkins-hbase4:36669] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-17 17:03:28,340 INFO [M:0;jenkins-hbase4:36669] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-17 17:03:28,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 17:03:28,341 DEBUG [M:0;jenkins-hbase4:36669] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-17 17:03:28,341 INFO [M:0;jenkins-hbase4:36669] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 17:03:28,341 DEBUG [M:0;jenkins-hbase4:36669] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 17:03:28,341 DEBUG [M:0;jenkins-hbase4:36669] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-17 17:03:28,341 DEBUG [M:0;jenkins-hbase4:36669] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 17:03:28,341 INFO [M:0;jenkins-hbase4:36669] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.68 KB heapSize=452 KB 2023-09-17 17:03:28,354 INFO [M:0;jenkins-hbase4:36669] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.68 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/12e09c0bf0164eb7929333f8bcc6380a 2023-09-17 17:03:28,358 INFO [M:0;jenkins-hbase4:36669] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12e09c0bf0164eb7929333f8bcc6380a 2023-09-17 17:03:28,359 DEBUG [M:0;jenkins-hbase4:36669] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/12e09c0bf0164eb7929333f8bcc6380a as hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/12e09c0bf0164eb7929333f8bcc6380a 2023-09-17 17:03:28,363 INFO [M:0;jenkins-hbase4:36669] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12e09c0bf0164eb7929333f8bcc6380a 2023-09-17 17:03:28,363 INFO [M:0;jenkins-hbase4:36669] regionserver.HStore(1080): Added hdfs://localhost:35449/user/jenkins/test-data/ecb5c71c-16e5-f6fa-1195-d8ac810423f3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/12e09c0bf0164eb7929333f8bcc6380a, entries=119, sequenceid=899, filesize=28.6 K 2023-09-17 17:03:28,364 INFO [M:0;jenkins-hbase4:36669] regionserver.HRegion(2948): Finished flush of dataSize ~375.68 KB/384699, heapSize ~451.98 KB/462832, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-09-17 17:03:28,366 INFO [M:0;jenkins-hbase4:36669] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 17:03:28,366 DEBUG [M:0;jenkins-hbase4:36669] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-17 17:03:28,370 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-17 17:03:28,370 INFO [M:0;jenkins-hbase4:36669] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-17 17:03:28,370 INFO [M:0;jenkins-hbase4:36669] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36669 2023-09-17 17:03:28,372 DEBUG [M:0;jenkins-hbase4:36669] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36669,1694970064919 already deleted, retry=false 2023-09-17 17:03:28,432 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 17:03:28,432 INFO [RS:2;jenkins-hbase4:42773] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42773,1694970066257; zookeeper connection closed. 2023-09-17 17:03:28,432 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): regionserver:42773-0x100bad5e4210003, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 17:03:28,433 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c239278] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c239278 2023-09-17 17:03:28,433 INFO [Listener at jenkins-hbase4.apache.org/42231] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-17 17:03:28,532 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 17:03:28,532 INFO [M:0;jenkins-hbase4:36669] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36669,1694970064919; zookeeper connection closed. 2023-09-17 17:03:28,532 DEBUG [Listener at localhost/37077-EventThread] zookeeper.ZKWatcher(600): master:36669-0x100bad5e4210000, quorum=127.0.0.1:59728, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 17:03:28,534 WARN [Listener at jenkins-hbase4.apache.org/42231] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-17 17:03:28,536 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-17 17:03:28,640 WARN [BP-1220982018-172.31.14.131-1694970061314 heartbeating to localhost/127.0.0.1:35449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-17 17:03:28,640 WARN [BP-1220982018-172.31.14.131-1694970061314 heartbeating to localhost/127.0.0.1:35449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1220982018-172.31.14.131-1694970061314 (Datanode Uuid 28e4a497-8bda-4033-b57e-e0f08b6640fb) service to localhost/127.0.0.1:35449 2023-09-17 17:03:28,642 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data5/current/BP-1220982018-172.31.14.131-1694970061314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 17:03:28,642 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data6/current/BP-1220982018-172.31.14.131-1694970061314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 17:03:28,643 WARN [Listener at jenkins-hbase4.apache.org/42231] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-17 17:03:28,645 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-17 17:03:28,766 WARN [BP-1220982018-172.31.14.131-1694970061314 heartbeating to localhost/127.0.0.1:35449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-17 17:03:28,766 WARN [BP-1220982018-172.31.14.131-1694970061314 heartbeating to localhost/127.0.0.1:35449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1220982018-172.31.14.131-1694970061314 (Datanode Uuid b549da05-a7c2-4e21-aa6c-7e9fbd5b6e21) service to localhost/127.0.0.1:35449 2023-09-17 17:03:28,767 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data3/current/BP-1220982018-172.31.14.131-1694970061314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 17:03:28,767 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data4/current/BP-1220982018-172.31.14.131-1694970061314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 17:03:28,767 WARN [Listener at jenkins-hbase4.apache.org/42231] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-17 17:03:28,769 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-17 17:03:28,872 WARN [BP-1220982018-172.31.14.131-1694970061314 heartbeating to localhost/127.0.0.1:35449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-17 17:03:28,872 WARN [BP-1220982018-172.31.14.131-1694970061314 heartbeating to localhost/127.0.0.1:35449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1220982018-172.31.14.131-1694970061314 (Datanode Uuid 9a8fe709-bfe5-4167-9df4-cc0d840b12b7) service to localhost/127.0.0.1:35449 2023-09-17 17:03:28,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data1/current/BP-1220982018-172.31.14.131-1694970061314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 17:03:28,873 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/29bd2c5f-ca0e-0a9f-1f9f-b0d87eaa814e/cluster_9b0a34b1-74ba-6430-bc1d-f1e2878085a7/dfs/data/data2/current/BP-1220982018-172.31.14.131-1694970061314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 17:03:28,892 INFO [Listener at jenkins-hbase4.apache.org/42231] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-17 17:03:29,017 INFO [Listener at jenkins-hbase4.apache.org/42231] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-17 17:03:29,107 INFO [Listener at jenkins-hbase4.apache.org/42231] hbase.HBaseTestingUtility(1293): Minicluster is down