2023-09-24 02:58:58,277 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-24 02:58:58,446 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b 2023-09-24 02:58:58,446 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-24 02:58:58,447 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-24 02:58:58,484 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-24 02:58:58,705 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-24 02:58:58,706 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29, deleteOnExit=true 2023-09-24 02:58:58,706 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-24 02:58:58,706 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/test.cache.data in system properties and HBase conf 2023-09-24 02:58:58,707 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop.tmp.dir in system properties and HBase conf 2023-09-24 02:58:58,707 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop.log.dir in system properties and HBase conf 2023-09-24 02:58:58,708 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-24 02:58:58,708 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-24 02:58:58,708 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-24 02:58:58,995 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-24 02:58:58,999 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-24 02:58:59,000 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-24 02:58:59,000 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-24 02:58:59,000 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 02:58:59,001 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-24 02:58:59,001 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-24 02:58:59,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 02:58:59,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 02:58:59,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-24 02:58:59,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/nfs.dump.dir in system properties and HBase conf 2023-09-24 02:58:59,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir in system properties and HBase conf 2023-09-24 02:58:59,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 02:58:59,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-24 02:58:59,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-24 02:58:59,471 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-24 02:58:59,475 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-24 02:58:59,732 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-24 02:58:59,904 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-24 02:58:59,923 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 02:58:59,965 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 02:58:59,995 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir/Jetty_localhost_33403_hdfs____.aocewv/webapp 2023-09-24 02:59:00,118 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33403 2023-09-24 02:59:00,164 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-24 02:59:00,164 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-24 02:59:00,580 WARN [Listener at localhost/42749] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 02:59:00,646 WARN [Listener at localhost/42749] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 02:59:00,664 WARN [Listener at localhost/42749] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 02:59:00,669 INFO [Listener at localhost/42749] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 02:59:00,675 INFO [Listener at localhost/42749] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir/Jetty_localhost_38089_datanode____pqu177/webapp 2023-09-24 02:59:00,753 INFO [Listener at localhost/42749] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38089 2023-09-24 02:59:01,218 WARN [Listener at localhost/36913] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 02:59:01,237 WARN [Listener at localhost/36913] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 02:59:01,242 WARN [Listener at localhost/36913] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 02:59:01,244 INFO [Listener at localhost/36913] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 02:59:01,257 INFO [Listener at localhost/36913] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir/Jetty_localhost_36639_datanode____kxqou8/webapp 2023-09-24 02:59:01,339 INFO [Listener at localhost/36913] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36639 2023-09-24 02:59:01,352 WARN [Listener at localhost/38903] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 02:59:01,371 WARN [Listener at localhost/38903] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 02:59:01,374 WARN [Listener at localhost/38903] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 02:59:01,375 INFO [Listener at localhost/38903] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 02:59:01,383 INFO [Listener at localhost/38903] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir/Jetty_localhost_34753_datanode____447uuz/webapp 2023-09-24 02:59:01,475 INFO [Listener at localhost/38903] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34753 2023-09-24 02:59:01,490 WARN [Listener at localhost/34569] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 02:59:01,778 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x99f09c8adb3f5f1a: Processing first storage report for DS-91000480-67c6-4fa9-8edd-029c2ba1f900 from datanode 588da7dd-d9f6-44fd-b745-bdc2b0602739 2023-09-24 02:59:01,780 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x99f09c8adb3f5f1a: from storage DS-91000480-67c6-4fa9-8edd-029c2ba1f900 node DatanodeRegistration(127.0.0.1:34551, datanodeUuid=588da7dd-d9f6-44fd-b745-bdc2b0602739, infoPort=45569, infoSecurePort=0, ipcPort=38903, storageInfo=lv=-57;cid=testClusterID;nsid=213635364;c=1695524339546), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-24 02:59:01,780 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc80bdfcd89bb1880: Processing first storage report for DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a from datanode a5e7cf8a-b768-4bf8-b378-6fa217b59d27 2023-09-24 02:59:01,781 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc80bdfcd89bb1880: from storage DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a node DatanodeRegistration(127.0.0.1:32945, datanodeUuid=a5e7cf8a-b768-4bf8-b378-6fa217b59d27, infoPort=46083, infoSecurePort=0, ipcPort=34569, storageInfo=lv=-57;cid=testClusterID;nsid=213635364;c=1695524339546), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 02:59:01,781 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x860361980b74fa37: Processing first storage report for DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16 from datanode f3ab2fa5-1c59-4491-a50e-572eefd37b34 2023-09-24 02:59:01,781 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x860361980b74fa37: from storage DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16 node DatanodeRegistration(127.0.0.1:33653, datanodeUuid=f3ab2fa5-1c59-4491-a50e-572eefd37b34, infoPort=39479, infoSecurePort=0, ipcPort=36913, storageInfo=lv=-57;cid=testClusterID;nsid=213635364;c=1695524339546), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 02:59:01,781 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x99f09c8adb3f5f1a: Processing first storage report for DS-f0981a73-baef-49b0-8ba9-3c6a2640a282 from datanode 588da7dd-d9f6-44fd-b745-bdc2b0602739 2023-09-24 02:59:01,782 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x99f09c8adb3f5f1a: from storage DS-f0981a73-baef-49b0-8ba9-3c6a2640a282 node DatanodeRegistration(127.0.0.1:34551, datanodeUuid=588da7dd-d9f6-44fd-b745-bdc2b0602739, infoPort=45569, infoSecurePort=0, ipcPort=38903, storageInfo=lv=-57;cid=testClusterID;nsid=213635364;c=1695524339546), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 02:59:01,782 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc80bdfcd89bb1880: Processing first storage report for DS-751e3fa4-dd31-4f7d-9c16-651f06cda0a8 from datanode a5e7cf8a-b768-4bf8-b378-6fa217b59d27 2023-09-24 02:59:01,782 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc80bdfcd89bb1880: from storage DS-751e3fa4-dd31-4f7d-9c16-651f06cda0a8 node DatanodeRegistration(127.0.0.1:32945, datanodeUuid=a5e7cf8a-b768-4bf8-b378-6fa217b59d27, infoPort=46083, infoSecurePort=0, ipcPort=34569, storageInfo=lv=-57;cid=testClusterID;nsid=213635364;c=1695524339546), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 02:59:01,782 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x860361980b74fa37: Processing first storage report for DS-788747de-c146-4d70-8d01-aaaee1f24000 from datanode f3ab2fa5-1c59-4491-a50e-572eefd37b34 2023-09-24 02:59:01,782 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x860361980b74fa37: from storage DS-788747de-c146-4d70-8d01-aaaee1f24000 node DatanodeRegistration(127.0.0.1:33653, datanodeUuid=f3ab2fa5-1c59-4491-a50e-572eefd37b34, infoPort=39479, infoSecurePort=0, ipcPort=36913, storageInfo=lv=-57;cid=testClusterID;nsid=213635364;c=1695524339546), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-24 02:59:01,929 DEBUG [Listener at localhost/34569] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b 2023-09-24 02:59:02,004 INFO [Listener at localhost/34569] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/zookeeper_0, clientPort=50111, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-24 02:59:02,023 INFO [Listener at localhost/34569] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50111 2023-09-24 02:59:02,033 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:02,036 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:02,702 INFO [Listener at localhost/34569] util.FSUtils(471): Created version file at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f with version=8 2023-09-24 02:59:02,703 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/hbase-staging 2023-09-24 02:59:03,011 INFO [Listener at localhost/34569] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-24 02:59:03,489 INFO [Listener at localhost/34569] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-09-24 02:59:03,515 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:03,516 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:03,516 INFO [Listener at localhost/34569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 02:59:03,516 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:03,516 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 02:59:03,643 INFO [Listener at localhost/34569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 02:59:03,704 DEBUG [Listener at localhost/34569] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-24 02:59:03,785 INFO [Listener at localhost/34569] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34295 2023-09-24 02:59:03,795 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:03,797 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:03,817 INFO [Listener at localhost/34569] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34295 connecting to ZooKeeper ensemble=127.0.0.1:50111 2023-09-24 02:59:03,868 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:342950x0, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 02:59:03,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34295-0x100c7631a060000 connected 2023-09-24 02:59:03,902 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 02:59:03,902 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 02:59:03,913 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 02:59:03,920 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34295 2023-09-24 02:59:03,920 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34295 2023-09-24 02:59:03,921 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34295 2023-09-24 02:59:03,921 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34295 2023-09-24 02:59:03,921 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34295 2023-09-24 02:59:03,927 INFO [Listener at localhost/34569] master.HMaster(444): hbase.rootdir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f, hbase.cluster.distributed=false 2023-09-24 02:59:03,981 INFO [Listener at localhost/34569] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-24 02:59:03,981 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:03,982 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:03,982 INFO [Listener at localhost/34569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 02:59:03,982 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:03,982 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 02:59:03,986 INFO [Listener at localhost/34569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 02:59:03,989 INFO [Listener at localhost/34569] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38603 2023-09-24 02:59:03,991 INFO [Listener at localhost/34569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 02:59:03,997 INFO [Listener at localhost/34569] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 02:59:03,998 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:04,000 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:04,002 INFO [Listener at localhost/34569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38603 connecting to ZooKeeper ensemble=127.0.0.1:50111 2023-09-24 02:59:04,005 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:386030x0, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 02:59:04,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38603-0x100c7631a060001 connected 2023-09-24 02:59:04,006 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 02:59:04,008 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 02:59:04,009 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 02:59:04,009 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38603 2023-09-24 02:59:04,010 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38603 2023-09-24 02:59:04,011 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38603 2023-09-24 02:59:04,014 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38603 2023-09-24 02:59:04,015 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38603 2023-09-24 02:59:04,026 INFO [Listener at localhost/34569] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-24 02:59:04,026 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:04,027 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:04,028 INFO [Listener at localhost/34569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 02:59:04,028 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:04,028 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 02:59:04,028 INFO [Listener at localhost/34569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 02:59:04,030 INFO [Listener at localhost/34569] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35519 2023-09-24 02:59:04,031 INFO [Listener at localhost/34569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 02:59:04,032 INFO [Listener at localhost/34569] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 02:59:04,033 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:04,037 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:04,041 INFO [Listener at localhost/34569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35519 connecting to ZooKeeper ensemble=127.0.0.1:50111 2023-09-24 02:59:04,045 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:355190x0, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 02:59:04,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35519-0x100c7631a060002 connected 2023-09-24 02:59:04,046 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 02:59:04,047 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 02:59:04,048 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 02:59:04,050 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35519 2023-09-24 02:59:04,051 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35519 2023-09-24 02:59:04,051 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35519 2023-09-24 02:59:04,054 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35519 2023-09-24 02:59:04,054 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35519 2023-09-24 02:59:04,065 INFO [Listener at localhost/34569] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-24 02:59:04,065 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:04,065 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:04,065 INFO [Listener at localhost/34569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 02:59:04,065 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 02:59:04,066 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 02:59:04,066 INFO [Listener at localhost/34569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 02:59:04,067 INFO [Listener at localhost/34569] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37585 2023-09-24 02:59:04,067 INFO [Listener at localhost/34569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 02:59:04,068 INFO [Listener at localhost/34569] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 02:59:04,069 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:04,070 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:04,072 INFO [Listener at localhost/34569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37585 connecting to ZooKeeper ensemble=127.0.0.1:50111 2023-09-24 02:59:04,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:375850x0, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 02:59:04,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37585-0x100c7631a060003 connected 2023-09-24 02:59:04,078 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 02:59:04,079 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 02:59:04,080 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 02:59:04,082 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37585 2023-09-24 02:59:04,082 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37585 2023-09-24 02:59:04,086 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37585 2023-09-24 02:59:04,087 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37585 2023-09-24 02:59:04,087 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37585 2023-09-24 02:59:04,089 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 02:59:04,097 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-24 02:59:04,099 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 02:59:04,118 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 02:59:04,118 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 02:59:04,118 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 02:59:04,118 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 02:59:04,119 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:04,120 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-24 02:59:04,121 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,34295,1695524342827 from backup master directory 2023-09-24 02:59:04,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-24 02:59:04,130 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 02:59:04,130 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-24 02:59:04,131 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 02:59:04,131 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 02:59:04,134 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-24 02:59:04,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-24 02:59:04,230 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/hbase.id with ID: 2d2329c2-297f-4552-889e-626b4bba9595 2023-09-24 02:59:04,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 02:59:04,298 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:04,346 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x583c0f63 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:04,376 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ca2a415, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:04,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-24 02:59:04,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-24 02:59:04,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-24 02:59:04,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-24 02:59:04,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-24 02:59:04,425 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-24 02:59:04,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 02:59:04,459 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store-tmp 2023-09-24 02:59:04,495 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:04,495 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-24 02:59:04,495 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 02:59:04,495 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 02:59:04,495 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-24 02:59:04,496 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 02:59:04,496 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 02:59:04,496 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 02:59:04,497 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/WALs/jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 02:59:04,518 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34295%2C1695524342827, suffix=, logDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/WALs/jenkins-hbase20.apache.org,34295,1695524342827, archiveDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/oldWALs, maxLogs=10 2023-09-24 02:59:04,570 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK] 2023-09-24 02:59:04,570 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK] 2023-09-24 02:59:04,570 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK] 2023-09-24 02:59:04,578 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-24 02:59:04,640 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/WALs/jenkins-hbase20.apache.org,34295,1695524342827/jenkins-hbase20.apache.org%2C34295%2C1695524342827.1695524344527 2023-09-24 02:59:04,640 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK], DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK], DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK]] 2023-09-24 02:59:04,641 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-24 02:59:04,641 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:04,644 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 02:59:04,645 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 02:59:04,706 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-24 02:59:04,713 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-24 02:59:04,739 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-24 02:59:04,750 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:04,757 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-24 02:59:04,759 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-24 02:59:04,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 02:59:04,781 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:04,782 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66683039, jitterRate=-0.006345286965370178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:04,783 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 02:59:04,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-24 02:59:04,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-24 02:59:04,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-24 02:59:04,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-24 02:59:04,819 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-24 02:59:04,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 33 msec 2023-09-24 02:59:04,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-24 02:59:04,879 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-24 02:59:04,885 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-24 02:59:04,909 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-24 02:59:04,913 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-24 02:59:04,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-24 02:59:04,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-24 02:59:04,924 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-24 02:59:04,926 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:04,928 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-24 02:59:04,928 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-24 02:59:04,941 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-24 02:59:04,946 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 02:59:04,946 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 02:59:04,946 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 02:59:04,946 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 02:59:04,946 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:04,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,34295,1695524342827, sessionid=0x100c7631a060000, setting cluster-up flag (Was=false) 2023-09-24 02:59:04,960 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:04,964 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-24 02:59:04,965 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 02:59:04,969 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:04,973 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-24 02:59:04,974 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 02:59:04,977 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp 2023-09-24 02:59:04,991 INFO [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(951): ClusterId : 2d2329c2-297f-4552-889e-626b4bba9595 2023-09-24 02:59:04,991 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(951): ClusterId : 2d2329c2-297f-4552-889e-626b4bba9595 2023-09-24 02:59:04,992 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(951): ClusterId : 2d2329c2-297f-4552-889e-626b4bba9595 2023-09-24 02:59:04,998 DEBUG [RS:2;jenkins-hbase20:37585] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 02:59:04,998 DEBUG [RS:1;jenkins-hbase20:35519] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 02:59:04,998 DEBUG [RS:0;jenkins-hbase20:38603] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 02:59:05,006 DEBUG [RS:2;jenkins-hbase20:37585] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 02:59:05,006 DEBUG [RS:1;jenkins-hbase20:35519] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 02:59:05,006 DEBUG [RS:0;jenkins-hbase20:38603] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 02:59:05,006 DEBUG [RS:1;jenkins-hbase20:35519] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 02:59:05,006 DEBUG [RS:2;jenkins-hbase20:37585] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 02:59:05,006 DEBUG [RS:0;jenkins-hbase20:38603] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 02:59:05,023 DEBUG [RS:2;jenkins-hbase20:37585] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 02:59:05,023 DEBUG [RS:0;jenkins-hbase20:38603] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 02:59:05,028 DEBUG [RS:1;jenkins-hbase20:35519] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 02:59:05,030 DEBUG [RS:2;jenkins-hbase20:37585] zookeeper.ReadOnlyZKClient(139): Connect 0x52638b55 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:05,030 DEBUG [RS:0;jenkins-hbase20:38603] zookeeper.ReadOnlyZKClient(139): Connect 0x546593a5 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:05,031 DEBUG [RS:1;jenkins-hbase20:35519] zookeeper.ReadOnlyZKClient(139): Connect 0x7c3abd8e to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:05,044 DEBUG [RS:0;jenkins-hbase20:38603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5aa27759, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:05,045 DEBUG [RS:0;jenkins-hbase20:38603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e9df8d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-24 02:59:05,051 DEBUG [RS:1;jenkins-hbase20:35519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72fd4c79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:05,052 DEBUG [RS:1;jenkins-hbase20:35519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76c2d6fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-24 02:59:05,073 DEBUG [RS:2;jenkins-hbase20:37585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ca46f69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:05,074 DEBUG [RS:2;jenkins-hbase20:37585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@589be025, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-24 02:59:05,099 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:37585 2023-09-24 02:59:05,099 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:35519 2023-09-24 02:59:05,100 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:38603 2023-09-24 02:59:05,102 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-24 02:59:05,105 INFO [RS:2;jenkins-hbase20:37585] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 02:59:05,105 INFO [RS:0;jenkins-hbase20:38603] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 02:59:05,105 INFO [RS:1;jenkins-hbase20:35519] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 02:59:05,106 INFO [RS:1;jenkins-hbase20:35519] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 02:59:05,106 INFO [RS:0;jenkins-hbase20:38603] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 02:59:05,105 INFO [RS:2;jenkins-hbase20:37585] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 02:59:05,106 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 02:59:05,106 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 02:59:05,106 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 02:59:05,108 INFO [RS:1;jenkins-hbase20:35519] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:05,108 INFO [RS:0;jenkins-hbase20:38603] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:05,108 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 02:59:05,108 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:05,108 INFO [RS:2;jenkins-hbase20:37585] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:05,108 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 02:59:05,108 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 02:59:05,109 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-24 02:59:05,111 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,34295,1695524342827 with isa=jenkins-hbase20.apache.org/148.251.75.209:37585, startcode=1695524344064 2023-09-24 02:59:05,111 INFO [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,34295,1695524342827 with isa=jenkins-hbase20.apache.org/148.251.75.209:38603, startcode=1695524343980 2023-09-24 02:59:05,111 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,34295,1695524342827 with isa=jenkins-hbase20.apache.org/148.251.75.209:35519, startcode=1695524344025 2023-09-24 02:59:05,126 DEBUG [RS:1;jenkins-hbase20:35519] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 02:59:05,126 DEBUG [RS:2;jenkins-hbase20:37585] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 02:59:05,126 DEBUG [RS:0;jenkins-hbase20:38603] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 02:59:05,180 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35447, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 02:59:05,180 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55643, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 02:59:05,180 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48983, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 02:59:05,188 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-24 02:59:05,189 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34295] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 02:59:05,197 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34295] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 02:59:05,198 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34295] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 02:59:05,198 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-24 02:59:05,199 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-24 02:59:05,199 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-24 02:59:05,199 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-24 02:59:05,199 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-09-24 02:59:05,199 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,200 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-24 02:59:05,200 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,201 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695524375201 2023-09-24 02:59:05,205 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-24 02:59:05,208 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-24 02:59:05,209 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-24 02:59:05,214 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 02:59:05,217 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-24 02:59:05,219 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 02:59:05,223 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 02:59:05,223 WARN [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 02:59:05,223 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 02:59:05,223 WARN [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 02:59:05,223 WARN [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 02:59:05,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-24 02:59:05,226 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-24 02:59:05,226 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-24 02:59:05,227 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-24 02:59:05,227 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,229 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-24 02:59:05,230 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-24 02:59:05,231 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-24 02:59:05,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-24 02:59:05,235 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-24 02:59:05,238 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695524345237,5,FailOnTimeoutGroup] 2023-09-24 02:59:05,238 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695524345238,5,FailOnTimeoutGroup] 2023-09-24 02:59:05,238 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,238 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-24 02:59:05,240 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,240 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,256 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-24 02:59:05,257 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-24 02:59:05,257 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:05,280 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:05,283 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-24 02:59:05,285 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/info 2023-09-24 02:59:05,286 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-24 02:59:05,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:05,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-24 02:59:05,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/rep_barrier 2023-09-24 02:59:05,290 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-24 02:59:05,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:05,291 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-24 02:59:05,292 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/table 2023-09-24 02:59:05,293 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-24 02:59:05,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:05,295 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740 2023-09-24 02:59:05,296 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740 2023-09-24 02:59:05,299 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-24 02:59:05,301 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-24 02:59:05,305 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:05,306 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59135717, jitterRate=-0.11880914866924286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-24 02:59:05,306 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-24 02:59:05,306 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-24 02:59:05,306 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-24 02:59:05,306 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-24 02:59:05,306 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-24 02:59:05,307 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-24 02:59:05,308 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-24 02:59:05,309 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-24 02:59:05,314 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-24 02:59:05,314 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-24 02:59:05,324 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,34295,1695524342827 with isa=jenkins-hbase20.apache.org/148.251.75.209:35519, startcode=1695524344025 2023-09-24 02:59:05,324 INFO [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,34295,1695524342827 with isa=jenkins-hbase20.apache.org/148.251.75.209:38603, startcode=1695524343980 2023-09-24 02:59:05,325 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,34295,1695524342827 with isa=jenkins-hbase20.apache.org/148.251.75.209:37585, startcode=1695524344064 2023-09-24 02:59:05,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-24 02:59:05,331 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34295] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:05,335 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34295] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,337 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34295] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:05,338 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:05,338 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42749 2023-09-24 02:59:05,338 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 02:59:05,338 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:05,339 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42749 2023-09-24 02:59:05,339 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 02:59:05,340 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:05,340 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42749 2023-09-24 02:59:05,340 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 02:59:05,345 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-24 02:59:05,345 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 02:59:05,347 DEBUG [RS:0;jenkins-hbase20:38603] zookeeper.ZKUtil(162): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:05,347 WARN [RS:0;jenkins-hbase20:38603] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 02:59:05,347 DEBUG [RS:2;jenkins-hbase20:37585] zookeeper.ZKUtil(162): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,347 INFO [RS:0;jenkins-hbase20:38603] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 02:59:05,348 DEBUG [RS:1;jenkins-hbase20:35519] zookeeper.ZKUtil(162): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:05,348 WARN [RS:1;jenkins-hbase20:35519] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 02:59:05,347 WARN [RS:2;jenkins-hbase20:37585] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 02:59:05,348 INFO [RS:1;jenkins-hbase20:35519] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 02:59:05,349 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:05,349 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38603,1695524343980] 2023-09-24 02:59:05,349 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,37585,1695524344064] 2023-09-24 02:59:05,349 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,35519,1695524344025] 2023-09-24 02:59:05,348 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:05,349 INFO [RS:2;jenkins-hbase20:37585] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 02:59:05,351 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,351 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-24 02:59:05,363 DEBUG [RS:2;jenkins-hbase20:37585] zookeeper.ZKUtil(162): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:05,363 DEBUG [RS:1;jenkins-hbase20:35519] zookeeper.ZKUtil(162): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:05,363 DEBUG [RS:0;jenkins-hbase20:38603] zookeeper.ZKUtil(162): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:05,363 DEBUG [RS:2;jenkins-hbase20:37585] zookeeper.ZKUtil(162): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,364 DEBUG [RS:1;jenkins-hbase20:35519] zookeeper.ZKUtil(162): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,364 DEBUG [RS:0;jenkins-hbase20:38603] zookeeper.ZKUtil(162): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,364 DEBUG [RS:2;jenkins-hbase20:37585] zookeeper.ZKUtil(162): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:05,364 DEBUG [RS:1;jenkins-hbase20:35519] zookeeper.ZKUtil(162): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:05,364 DEBUG [RS:0;jenkins-hbase20:38603] zookeeper.ZKUtil(162): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:05,374 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 02:59:05,374 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 02:59:05,374 DEBUG [RS:0;jenkins-hbase20:38603] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 02:59:05,383 INFO [RS:2;jenkins-hbase20:37585] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 02:59:05,384 INFO [RS:1;jenkins-hbase20:35519] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 02:59:05,383 INFO [RS:0;jenkins-hbase20:38603] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 02:59:05,407 INFO [RS:1;jenkins-hbase20:35519] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 02:59:05,407 INFO [RS:0;jenkins-hbase20:38603] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 02:59:05,407 INFO [RS:2;jenkins-hbase20:37585] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 02:59:05,412 INFO [RS:1;jenkins-hbase20:35519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 02:59:05,412 INFO [RS:0;jenkins-hbase20:38603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 02:59:05,412 INFO [RS:2;jenkins-hbase20:37585] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 02:59:05,413 INFO [RS:0;jenkins-hbase20:38603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,412 INFO [RS:1;jenkins-hbase20:35519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,413 INFO [RS:2;jenkins-hbase20:37585] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,413 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 02:59:05,413 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 02:59:05,413 INFO [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 02:59:05,421 INFO [RS:0;jenkins-hbase20:38603] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,421 INFO [RS:1;jenkins-hbase20:35519] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,421 INFO [RS:2;jenkins-hbase20:37585] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,422 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,422 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,422 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,422 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,422 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,422 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,422 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,422 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,422 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-24 02:59:05,423 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-24 02:59:05,423 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-24 02:59:05,423 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,424 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,423 DEBUG [RS:0;jenkins-hbase20:38603] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,424 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,424 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,424 DEBUG [RS:2;jenkins-hbase20:37585] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,424 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,425 DEBUG [RS:1;jenkins-hbase20:35519] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-24 02:59:05,426 INFO [RS:0;jenkins-hbase20:38603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,426 INFO [RS:2;jenkins-hbase20:37585] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,426 INFO [RS:0;jenkins-hbase20:38603] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,426 INFO [RS:2;jenkins-hbase20:37585] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,426 INFO [RS:0;jenkins-hbase20:38603] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,426 INFO [RS:2;jenkins-hbase20:37585] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,428 INFO [RS:1;jenkins-hbase20:35519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,428 INFO [RS:1;jenkins-hbase20:35519] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,428 INFO [RS:1;jenkins-hbase20:35519] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,442 INFO [RS:0;jenkins-hbase20:38603] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 02:59:05,442 INFO [RS:2;jenkins-hbase20:37585] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 02:59:05,445 INFO [RS:1;jenkins-hbase20:35519] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 02:59:05,446 INFO [RS:1;jenkins-hbase20:35519] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35519,1695524344025-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,446 INFO [RS:2;jenkins-hbase20:37585] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37585,1695524344064-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,446 INFO [RS:0;jenkins-hbase20:38603] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38603,1695524343980-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,472 INFO [RS:0;jenkins-hbase20:38603] regionserver.Replication(203): jenkins-hbase20.apache.org,38603,1695524343980 started 2023-09-24 02:59:05,472 INFO [RS:1;jenkins-hbase20:35519] regionserver.Replication(203): jenkins-hbase20.apache.org,35519,1695524344025 started 2023-09-24 02:59:05,472 INFO [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38603,1695524343980, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38603, sessionid=0x100c7631a060001 2023-09-24 02:59:05,472 INFO [RS:2;jenkins-hbase20:37585] regionserver.Replication(203): jenkins-hbase20.apache.org,37585,1695524344064 started 2023-09-24 02:59:05,472 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,35519,1695524344025, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:35519, sessionid=0x100c7631a060002 2023-09-24 02:59:05,472 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,37585,1695524344064, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:37585, sessionid=0x100c7631a060003 2023-09-24 02:59:05,472 DEBUG [RS:0;jenkins-hbase20:38603] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 02:59:05,472 DEBUG [RS:1;jenkins-hbase20:35519] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 02:59:05,472 DEBUG [RS:2;jenkins-hbase20:37585] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 02:59:05,472 DEBUG [RS:1;jenkins-hbase20:35519] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:05,472 DEBUG [RS:0;jenkins-hbase20:38603] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:05,473 DEBUG [RS:1;jenkins-hbase20:35519] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35519,1695524344025' 2023-09-24 02:59:05,473 DEBUG [RS:2;jenkins-hbase20:37585] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,474 DEBUG [RS:2;jenkins-hbase20:37585] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37585,1695524344064' 2023-09-24 02:59:05,473 DEBUG [RS:1;jenkins-hbase20:35519] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 02:59:05,473 DEBUG [RS:0;jenkins-hbase20:38603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38603,1695524343980' 2023-09-24 02:59:05,474 DEBUG [RS:2;jenkins-hbase20:37585] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 02:59:05,474 DEBUG [RS:0;jenkins-hbase20:38603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 02:59:05,478 DEBUG [RS:2;jenkins-hbase20:37585] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 02:59:05,479 DEBUG [RS:0;jenkins-hbase20:38603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 02:59:05,479 DEBUG [RS:1;jenkins-hbase20:35519] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 02:59:05,479 DEBUG [RS:0;jenkins-hbase20:38603] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 02:59:05,479 DEBUG [RS:1;jenkins-hbase20:35519] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 02:59:05,479 DEBUG [RS:0;jenkins-hbase20:38603] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 02:59:05,479 DEBUG [RS:2;jenkins-hbase20:37585] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 02:59:05,479 DEBUG [RS:0;jenkins-hbase20:38603] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:05,479 DEBUG [RS:1;jenkins-hbase20:35519] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 02:59:05,479 DEBUG [RS:0;jenkins-hbase20:38603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38603,1695524343980' 2023-09-24 02:59:05,480 DEBUG [RS:0;jenkins-hbase20:38603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:05,479 DEBUG [RS:2;jenkins-hbase20:37585] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 02:59:05,479 DEBUG [RS:1;jenkins-hbase20:35519] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:05,480 DEBUG [RS:2;jenkins-hbase20:37585] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,480 DEBUG [RS:1;jenkins-hbase20:35519] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35519,1695524344025' 2023-09-24 02:59:05,480 DEBUG [RS:1;jenkins-hbase20:35519] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:05,480 DEBUG [RS:2;jenkins-hbase20:37585] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37585,1695524344064' 2023-09-24 02:59:05,480 DEBUG [RS:0;jenkins-hbase20:38603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:05,480 DEBUG [RS:2;jenkins-hbase20:37585] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:05,481 DEBUG [RS:1;jenkins-hbase20:35519] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:05,481 DEBUG [RS:0;jenkins-hbase20:38603] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 02:59:05,481 DEBUG [RS:2;jenkins-hbase20:37585] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:05,481 INFO [RS:0;jenkins-hbase20:38603] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 02:59:05,481 DEBUG [RS:1;jenkins-hbase20:35519] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 02:59:05,481 INFO [RS:0;jenkins-hbase20:38603] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 02:59:05,481 INFO [RS:1;jenkins-hbase20:35519] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 02:59:05,482 INFO [RS:1;jenkins-hbase20:35519] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 02:59:05,483 DEBUG [RS:2;jenkins-hbase20:37585] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 02:59:05,483 INFO [RS:2;jenkins-hbase20:37585] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 02:59:05,483 INFO [RS:2;jenkins-hbase20:37585] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 02:59:05,504 DEBUG [jenkins-hbase20:34295] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-24 02:59:05,508 DEBUG [jenkins-hbase20:34295] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 02:59:05,513 DEBUG [jenkins-hbase20:34295] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 02:59:05,513 DEBUG [jenkins-hbase20:34295] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 02:59:05,513 DEBUG [jenkins-hbase20:34295] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 02:59:05,513 DEBUG [jenkins-hbase20:34295] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 02:59:05,516 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37585,1695524344064, state=OPENING 2023-09-24 02:59:05,522 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-24 02:59:05,523 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:05,524 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-24 02:59:05,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 02:59:05,591 INFO [RS:2;jenkins-hbase20:37585] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37585%2C1695524344064, suffix=, logDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,37585,1695524344064, archiveDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/oldWALs, maxLogs=32 2023-09-24 02:59:05,591 INFO [RS:0;jenkins-hbase20:38603] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38603%2C1695524343980, suffix=, logDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,38603,1695524343980, archiveDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/oldWALs, maxLogs=32 2023-09-24 02:59:05,591 INFO [RS:1;jenkins-hbase20:35519] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35519%2C1695524344025, suffix=, logDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,35519,1695524344025, archiveDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/oldWALs, maxLogs=32 2023-09-24 02:59:05,620 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK] 2023-09-24 02:59:05,622 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK] 2023-09-24 02:59:05,623 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK] 2023-09-24 02:59:05,623 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK] 2023-09-24 02:59:05,628 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK] 2023-09-24 02:59:05,628 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK] 2023-09-24 02:59:05,628 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK] 2023-09-24 02:59:05,629 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK] 2023-09-24 02:59:05,629 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK] 2023-09-24 02:59:05,647 INFO [RS:1;jenkins-hbase20:35519] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,35519,1695524344025/jenkins-hbase20.apache.org%2C35519%2C1695524344025.1695524345594 2023-09-24 02:59:05,648 INFO [RS:0;jenkins-hbase20:38603] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,38603,1695524343980/jenkins-hbase20.apache.org%2C38603%2C1695524343980.1695524345594 2023-09-24 02:59:05,648 INFO [RS:2;jenkins-hbase20:37585] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,37585,1695524344064/jenkins-hbase20.apache.org%2C37585%2C1695524344064.1695524345594 2023-09-24 02:59:05,648 DEBUG [RS:1;jenkins-hbase20:35519] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK], DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK], DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK]] 2023-09-24 02:59:05,648 DEBUG [RS:2;jenkins-hbase20:37585] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK], DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK], DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK]] 2023-09-24 02:59:05,648 DEBUG [RS:0;jenkins-hbase20:38603] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK], DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK], DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK]] 2023-09-24 02:59:05,709 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:05,712 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 02:59:05,714 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 02:59:05,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-24 02:59:05,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 02:59:05,731 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37585%2C1695524344064.meta, suffix=.meta, logDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,37585,1695524344064, archiveDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/oldWALs, maxLogs=32 2023-09-24 02:59:05,749 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK] 2023-09-24 02:59:05,751 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK] 2023-09-24 02:59:05,752 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK] 2023-09-24 02:59:05,757 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/WALs/jenkins-hbase20.apache.org,37585,1695524344064/jenkins-hbase20.apache.org%2C37585%2C1695524344064.meta.1695524345733.meta 2023-09-24 02:59:05,758 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33653,DS-ecbec7e9-1dd2-40d2-8554-172961d5ec16,DISK], DatanodeInfoWithStorage[127.0.0.1:32945,DS-c4d1e47f-1a9f-444a-8779-dc1a1387559a,DISK], DatanodeInfoWithStorage[127.0.0.1:34551,DS-91000480-67c6-4fa9-8edd-029c2ba1f900,DISK]] 2023-09-24 02:59:05,758 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-24 02:59:05,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-24 02:59:05,761 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:05,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-24 02:59:05,763 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-24 02:59:05,764 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-24 02:59:05,778 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-24 02:59:05,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:05,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-24 02:59:05,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-24 02:59:05,781 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-24 02:59:05,783 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/info 2023-09-24 02:59:05,784 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/info 2023-09-24 02:59:05,784 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-24 02:59:05,785 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:05,786 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-24 02:59:05,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/rep_barrier 2023-09-24 02:59:05,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/rep_barrier 2023-09-24 02:59:05,788 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-24 02:59:05,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:05,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-24 02:59:05,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/table 2023-09-24 02:59:05,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/table 2023-09-24 02:59:05,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-24 02:59:05,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:05,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740 2023-09-24 02:59:05,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740 2023-09-24 02:59:05,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-24 02:59:05,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-24 02:59:05,804 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59184011, jitterRate=-0.11808951199054718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-24 02:59:05,806 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-24 02:59:05,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695524345703 2023-09-24 02:59:05,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-24 02:59:05,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-24 02:59:05,834 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37585,1695524344064, state=OPEN 2023-09-24 02:59:05,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-24 02:59:05,837 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-24 02:59:05,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-24 02:59:05,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37585,1695524344064 in 308 msec 2023-09-24 02:59:05,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-24 02:59:05,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 517 msec 2023-09-24 02:59:05,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 736 msec 2023-09-24 02:59:05,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695524345853, completionTime=-1 2023-09-24 02:59:05,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-24 02:59:05,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-24 02:59:05,913 DEBUG [hconnection-0x5e78051c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:05,916 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:05,941 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-24 02:59:05,941 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695524405941 2023-09-24 02:59:05,941 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695524465941 2023-09-24 02:59:05,941 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 88 msec 2023-09-24 02:59:05,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34295,1695524342827-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,971 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34295,1695524342827-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,971 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34295,1695524342827-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:34295, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-24 02:59:05,985 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-24 02:59:05,993 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-24 02:59:05,996 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 02:59:06,004 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-24 02:59:06,007 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 02:59:06,010 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 02:59:06,030 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,033 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed empty. 2023-09-24 02:59:06,034 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,034 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-24 02:59:06,069 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-24 02:59:06,071 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a79167d2d70acb808658c34229d25ed, NAME => 'hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 02:59:06,094 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:06,095 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1a79167d2d70acb808658c34229d25ed, disabling compactions & flushes 2023-09-24 02:59:06,095 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 02:59:06,095 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 02:59:06,095 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. after waiting 0 ms 2023-09-24 02:59:06,095 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 02:59:06,095 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 02:59:06,095 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1a79167d2d70acb808658c34229d25ed: 2023-09-24 02:59:06,102 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 02:59:06,117 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695524346105"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524346105"}]},"ts":"1695524346105"} 2023-09-24 02:59:06,145 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-24 02:59:06,148 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 02:59:06,152 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524346148"}]},"ts":"1695524346148"} 2023-09-24 02:59:06,159 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-24 02:59:06,162 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 02:59:06,164 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 02:59:06,164 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 02:59:06,164 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 02:59:06,164 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 02:59:06,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1a79167d2d70acb808658c34229d25ed, ASSIGN}] 2023-09-24 02:59:06,171 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1a79167d2d70acb808658c34229d25ed, ASSIGN 2023-09-24 02:59:06,173 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1a79167d2d70acb808658c34229d25ed, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35519,1695524344025; forceNewPlan=false, retain=false 2023-09-24 02:59:06,326 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 02:59:06,330 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1a79167d2d70acb808658c34229d25ed, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:06,330 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695524346329"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524346329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524346329"}]},"ts":"1695524346329"} 2023-09-24 02:59:06,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1a79167d2d70acb808658c34229d25ed, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 02:59:06,489 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:06,490 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 02:59:06,494 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 02:59:06,502 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 02:59:06,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a79167d2d70acb808658c34229d25ed, NAME => 'hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed.', STARTKEY => '', ENDKEY => ''} 2023-09-24 02:59:06,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. service=AccessControlService 2023-09-24 02:59:06,504 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:06,505 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,505 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:06,505 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,505 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,508 INFO [StoreOpener-1a79167d2d70acb808658c34229d25ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,510 DEBUG [StoreOpener-1a79167d2d70acb808658c34229d25ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed/info 2023-09-24 02:59:06,511 DEBUG [StoreOpener-1a79167d2d70acb808658c34229d25ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed/info 2023-09-24 02:59:06,511 INFO [StoreOpener-1a79167d2d70acb808658c34229d25ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a79167d2d70acb808658c34229d25ed columnFamilyName info 2023-09-24 02:59:06,512 INFO [StoreOpener-1a79167d2d70acb808658c34229d25ed-1] regionserver.HStore(310): Store=1a79167d2d70acb808658c34229d25ed/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:06,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1a79167d2d70acb808658c34229d25ed 2023-09-24 02:59:06,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:06,526 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1a79167d2d70acb808658c34229d25ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75431548, jitterRate=0.12401765584945679}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:06,526 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1a79167d2d70acb808658c34229d25ed: 2023-09-24 02:59:06,530 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed., pid=6, masterSystemTime=1695524346489 2023-09-24 02:59:06,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 02:59:06,536 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 02:59:06,537 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1a79167d2d70acb808658c34229d25ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:06,538 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695524346537"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524346537"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524346537"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524346537"}]},"ts":"1695524346537"} 2023-09-24 02:59:06,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-24 02:59:06,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1a79167d2d70acb808658c34229d25ed, server=jenkins-hbase20.apache.org,35519,1695524344025 in 206 msec 2023-09-24 02:59:06,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-24 02:59:06,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1a79167d2d70acb808658c34229d25ed, ASSIGN in 379 msec 2023-09-24 02:59:06,553 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 02:59:06,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524346553"}]},"ts":"1695524346553"} 2023-09-24 02:59:06,556 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-24 02:59:06,559 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 02:59:06,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 562 msec 2023-09-24 02:59:06,607 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-24 02:59:06,608 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-24 02:59:06,608 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:06,629 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:06,632 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:06,649 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-24 02:59:06,671 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-24 02:59:06,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-09-24 02:59:06,683 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-24 02:59:06,695 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-24 02:59:06,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-24 02:59:06,718 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-24 02:59:06,720 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-24 02:59:06,722 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.591sec 2023-09-24 02:59:06,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-24 02:59:06,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-24 02:59:06,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-24 02:59:06,728 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34295,1695524342827-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-24 02:59:06,729 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34295,1695524342827-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-24 02:59:06,747 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 02:59:06,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-24 02:59:06,752 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 02:59:06,754 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 02:59:06,756 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-24 02:59:06,757 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:06,758 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193 empty. 2023-09-24 02:59:06,760 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:06,760 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-24 02:59:06,791 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 02:59:06,798 DEBUG [Listener at localhost/34569] zookeeper.ReadOnlyZKClient(139): Connect 0x1bcaf3c7 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:06,803 DEBUG [Listener at localhost/34569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@348a0a6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:06,823 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-24 02:59:06,824 DEBUG [hconnection-0x182ba710-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:06,826 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 11b6caa21568f4c9b7647ba9b24ca193, NAME => 'hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 02:59:06,843 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:06,846 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 02:59:06,855 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-24 02:59:06,857 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/test.cache.data in system properties and HBase conf 2023-09-24 02:59:06,858 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop.tmp.dir in system properties and HBase conf 2023-09-24 02:59:06,858 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop.log.dir in system properties and HBase conf 2023-09-24 02:59:06,858 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-24 02:59:06,858 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-24 02:59:06,858 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-24 02:59:06,859 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-24 02:59:06,859 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-24 02:59:06,859 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-24 02:59:06,859 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 02:59:06,859 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-24 02:59:06,859 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-24 02:59:06,860 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 02:59:06,860 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 02:59:06,860 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-24 02:59:06,860 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/nfs.dump.dir in system properties and HBase conf 2023-09-24 02:59:06,861 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir in system properties and HBase conf 2023-09-24 02:59:06,861 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 02:59:06,861 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-24 02:59:06,862 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-24 02:59:06,865 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:06,865 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 11b6caa21568f4c9b7647ba9b24ca193, disabling compactions & flushes 2023-09-24 02:59:06,865 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 02:59:06,865 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 02:59:06,865 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. after waiting 0 ms 2023-09-24 02:59:06,865 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 02:59:06,865 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 02:59:06,865 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 11b6caa21568f4c9b7647ba9b24ca193: 2023-09-24 02:59:06,870 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 02:59:06,872 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695524346872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524346872"}]},"ts":"1695524346872"} 2023-09-24 02:59:06,875 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-24 02:59:06,876 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 02:59:06,876 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524346876"}]},"ts":"1695524346876"} 2023-09-24 02:59:06,879 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-24 02:59:06,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 02:59:06,885 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 02:59:06,886 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 02:59:06,886 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 02:59:06,886 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 02:59:06,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=11b6caa21568f4c9b7647ba9b24ca193, ASSIGN}] 2023-09-24 02:59:06,889 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=11b6caa21568f4c9b7647ba9b24ca193, ASSIGN 2023-09-24 02:59:06,890 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=11b6caa21568f4c9b7647ba9b24ca193, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37585,1695524344064; forceNewPlan=false, retain=false 2023-09-24 02:59:06,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 02:59:07,041 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 02:59:07,042 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=11b6caa21568f4c9b7647ba9b24ca193, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:07,042 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695524347042"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524347042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524347042"}]},"ts":"1695524347042"} 2023-09-24 02:59:07,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 11b6caa21568f4c9b7647ba9b24ca193, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 02:59:07,097 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 02:59:07,206 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 02:59:07,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11b6caa21568f4c9b7647ba9b24ca193, NAME => 'hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193.', STARTKEY => '', ENDKEY => ''} 2023-09-24 02:59:07,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. service=AccessControlService 2023-09-24 02:59:07,207 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:07,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:07,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:07,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:07,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:07,209 INFO [StoreOpener-11b6caa21568f4c9b7647ba9b24ca193-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:07,212 DEBUG [StoreOpener-11b6caa21568f4c9b7647ba9b24ca193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193/l 2023-09-24 02:59:07,212 DEBUG [StoreOpener-11b6caa21568f4c9b7647ba9b24ca193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193/l 2023-09-24 02:59:07,213 INFO [StoreOpener-11b6caa21568f4c9b7647ba9b24ca193-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11b6caa21568f4c9b7647ba9b24ca193 columnFamilyName l 2023-09-24 02:59:07,214 INFO [StoreOpener-11b6caa21568f4c9b7647ba9b24ca193-1] regionserver.HStore(310): Store=11b6caa21568f4c9b7647ba9b24ca193/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:07,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:07,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:07,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 02:59:07,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:07,230 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 11b6caa21568f4c9b7647ba9b24ca193; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69208144, jitterRate=0.03128170967102051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:07,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 11b6caa21568f4c9b7647ba9b24ca193: 2023-09-24 02:59:07,232 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193., pid=11, masterSystemTime=1695524347199 2023-09-24 02:59:07,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 02:59:07,235 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 02:59:07,236 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=11b6caa21568f4c9b7647ba9b24ca193, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:07,237 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695524347236"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524347236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524347236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524347236"}]},"ts":"1695524347236"} 2023-09-24 02:59:07,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-24 02:59:07,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 11b6caa21568f4c9b7647ba9b24ca193, server=jenkins-hbase20.apache.org,37585,1695524344064 in 195 msec 2023-09-24 02:59:07,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-24 02:59:07,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=11b6caa21568f4c9b7647ba9b24ca193, ASSIGN in 359 msec 2023-09-24 02:59:07,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 02:59:07,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524347253"}]},"ts":"1695524347253"} 2023-09-24 02:59:07,256 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-24 02:59:07,259 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 02:59:07,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 511 msec 2023-09-24 02:59:07,397 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 02:59:07,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-24 02:59:07,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-24 02:59:07,975 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 02:59:08,313 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 02:59:08,319 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_41705_jobhistory____.2lwqlg/webapp 2023-09-24 02:59:08,479 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-24 02:59:08,479 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-24 02:59:08,479 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 02:59:08,482 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 02:59:08,556 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:08,836 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:09,088 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-24 02:59:09,116 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:41705 2023-09-24 02:59:09,471 WARN [Listener at jenkins-hbase20.apache.org/34599] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 02:59:09,693 WARN [Listener at jenkins-hbase20.apache.org/34599] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 02:59:09,694 INFO [Listener at jenkins-hbase20.apache.org/34599] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 02:59:09,700 INFO [Listener at jenkins-hbase20.apache.org/34599] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_45103_cluster____mjpb6l/webapp 2023-09-24 02:59:09,757 INFO [Listener at jenkins-hbase20.apache.org/34599] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 02:59:09,757 INFO [Listener at jenkins-hbase20.apache.org/34599] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-24 02:59:09,757 INFO [Listener at jenkins-hbase20.apache.org/34599] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 02:59:09,757 INFO [Listener at jenkins-hbase20.apache.org/34599] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 02:59:09,765 INFO [Listener at jenkins-hbase20.apache.org/34599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:09,917 INFO [Listener at jenkins-hbase20.apache.org/34599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:09,995 INFO [Listener at jenkins-hbase20.apache.org/34599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:10,002 INFO [Listener at jenkins-hbase20.apache.org/34599] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:45103 2023-09-24 02:59:10,485 WARN [Listener at jenkins-hbase20.apache.org/37373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 02:59:10,518 WARN [Listener at jenkins-hbase20.apache.org/37373] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 02:59:10,518 INFO [Listener at jenkins-hbase20.apache.org/37373] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 02:59:10,527 INFO [Listener at jenkins-hbase20.apache.org/37373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_36363_node____s0lltr/webapp 2023-09-24 02:59:10,586 INFO [Listener at jenkins-hbase20.apache.org/37373] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-24 02:59:10,586 INFO [Listener at jenkins-hbase20.apache.org/37373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 02:59:10,586 INFO [Listener at jenkins-hbase20.apache.org/37373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 02:59:10,586 INFO [Listener at jenkins-hbase20.apache.org/37373] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 02:59:10,595 INFO [Listener at jenkins-hbase20.apache.org/37373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:10,616 INFO [Listener at jenkins-hbase20.apache.org/37373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:10,689 INFO [Listener at jenkins-hbase20.apache.org/37373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:10,699 INFO [Listener at jenkins-hbase20.apache.org/37373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:36363 2023-09-24 02:59:10,871 WARN [Listener at jenkins-hbase20.apache.org/38347] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 02:59:10,878 WARN [Listener at jenkins-hbase20.apache.org/38347] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 02:59:10,878 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 02:59:10,886 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_44087_node____.i0nq7z/webapp 2023-09-24 02:59:10,928 INFO [Listener at jenkins-hbase20.apache.org/38347] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-24 02:59:10,928 INFO [Listener at jenkins-hbase20.apache.org/38347] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 02:59:10,929 INFO [Listener at jenkins-hbase20.apache.org/38347] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 02:59:10,929 INFO [Listener at jenkins-hbase20.apache.org/38347] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 02:59:10,937 INFO [Listener at jenkins-hbase20.apache.org/38347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:10,952 INFO [Listener at jenkins-hbase20.apache.org/38347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:11,013 INFO [Listener at jenkins-hbase20.apache.org/38347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 02:59:11,018 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:44087 2023-09-24 02:59:11,042 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-24 02:59:11,044 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 02:59:11,090 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=171, AvailableMemoryMB=7897 2023-09-24 02:59:11,090 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-09-24 02:59:11,101 DEBUG [Listener at jenkins-hbase20.apache.org/38347] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-24 02:59:11,106 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-24 02:59:11,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 02:59:11,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-24 02:59:11,119 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 02:59:11,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-24 02:59:11,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 02:59:11,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 02:59:11,127 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,128 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,129 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741 empty. 2023-09-24 02:59:11,129 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc empty. 2023-09-24 02:59:11,130 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,130 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,130 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-24 02:59:11,164 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-24 02:59:11,165 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 688715887ac9a18be6ddc5a39815e741, NAME => 'testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 02:59:11,166 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e9e0055cfc0fdca7d346e5147caffebc, NAME => 'testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 02:59:11,205 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:11,205 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e9e0055cfc0fdca7d346e5147caffebc, disabling compactions & flushes 2023-09-24 02:59:11,205 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,205 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,206 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. after waiting 0 ms 2023-09-24 02:59:11,206 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,206 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,206 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e9e0055cfc0fdca7d346e5147caffebc: 2023-09-24 02:59:11,206 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:11,207 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 688715887ac9a18be6ddc5a39815e741, disabling compactions & flushes 2023-09-24 02:59:11,207 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,207 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,207 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. after waiting 0 ms 2023-09-24 02:59:11,207 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,207 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,207 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 688715887ac9a18be6ddc5a39815e741: 2023-09-24 02:59:11,211 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 02:59:11,213 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524351212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524351212"}]},"ts":"1695524351212"} 2023-09-24 02:59:11,213 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524351212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524351212"}]},"ts":"1695524351212"} 2023-09-24 02:59:11,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 02:59:11,255 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 02:59:11,257 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 02:59:11,257 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524351257"}]},"ts":"1695524351257"} 2023-09-24 02:59:11,259 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-24 02:59:11,263 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 02:59:11,265 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 02:59:11,265 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 02:59:11,265 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 02:59:11,265 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 02:59:11,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=688715887ac9a18be6ddc5a39815e741, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e9e0055cfc0fdca7d346e5147caffebc, ASSIGN}] 2023-09-24 02:59:11,269 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e9e0055cfc0fdca7d346e5147caffebc, ASSIGN 2023-09-24 02:59:11,269 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=688715887ac9a18be6ddc5a39815e741, ASSIGN 2023-09-24 02:59:11,270 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=688715887ac9a18be6ddc5a39815e741, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38603,1695524343980; forceNewPlan=false, retain=false 2023-09-24 02:59:11,270 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e9e0055cfc0fdca7d346e5147caffebc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37585,1695524344064; forceNewPlan=false, retain=false 2023-09-24 02:59:11,322 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 02:59:11,421 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 02:59:11,423 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e9e0055cfc0fdca7d346e5147caffebc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,423 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=688715887ac9a18be6ddc5a39815e741, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,423 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524351422"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524351422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524351422"}]},"ts":"1695524351422"} 2023-09-24 02:59:11,423 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524351422"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524351422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524351422"}]},"ts":"1695524351422"} 2023-09-24 02:59:11,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 02:59:11,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 688715887ac9a18be6ddc5a39815e741, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 02:59:11,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure e9e0055cfc0fdca7d346e5147caffebc, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 02:59:11,465 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-24 02:59:11,466 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-24 02:59:11,466 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-24 02:59:11,581 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,581 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 02:59:11,585 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 02:59:11,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 688715887ac9a18be6ddc5a39815e741, NAME => 'testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 02:59:11,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9e0055cfc0fdca7d346e5147caffebc, NAME => 'testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. service=AccessControlService 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. service=AccessControlService 2023-09-24 02:59:11,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:11,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,600 INFO [StoreOpener-688715887ac9a18be6ddc5a39815e741-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,600 INFO [StoreOpener-e9e0055cfc0fdca7d346e5147caffebc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,602 DEBUG [StoreOpener-e9e0055cfc0fdca7d346e5147caffebc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf 2023-09-24 02:59:11,602 DEBUG [StoreOpener-688715887ac9a18be6ddc5a39815e741-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf 2023-09-24 02:59:11,602 DEBUG [StoreOpener-688715887ac9a18be6ddc5a39815e741-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf 2023-09-24 02:59:11,602 DEBUG [StoreOpener-e9e0055cfc0fdca7d346e5147caffebc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf 2023-09-24 02:59:11,605 INFO [StoreOpener-688715887ac9a18be6ddc5a39815e741-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 688715887ac9a18be6ddc5a39815e741 columnFamilyName cf 2023-09-24 02:59:11,605 INFO [StoreOpener-e9e0055cfc0fdca7d346e5147caffebc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9e0055cfc0fdca7d346e5147caffebc columnFamilyName cf 2023-09-24 02:59:11,608 INFO [StoreOpener-688715887ac9a18be6ddc5a39815e741-1] regionserver.HStore(310): Store=688715887ac9a18be6ddc5a39815e741/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:11,608 INFO [StoreOpener-e9e0055cfc0fdca7d346e5147caffebc-1] regionserver.HStore(310): Store=e9e0055cfc0fdca7d346e5147caffebc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:11,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:11,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:11,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:11,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:11,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 688715887ac9a18be6ddc5a39815e741; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75246072, jitterRate=0.1212538480758667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:11,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e9e0055cfc0fdca7d346e5147caffebc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74649276, jitterRate=0.1123608946800232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:11,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 688715887ac9a18be6ddc5a39815e741: 2023-09-24 02:59:11,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e9e0055cfc0fdca7d346e5147caffebc: 2023-09-24 02:59:11,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc., pid=16, masterSystemTime=1695524351582 2023-09-24 02:59:11,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741., pid=15, masterSystemTime=1695524351581 2023-09-24 02:59:11,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,636 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e9e0055cfc0fdca7d346e5147caffebc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,637 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524351636"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524351636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524351636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524351636"}]},"ts":"1695524351636"} 2023-09-24 02:59:11,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,640 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=688715887ac9a18be6ddc5a39815e741, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,642 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524351640"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524351640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524351640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524351640"}]},"ts":"1695524351640"} 2023-09-24 02:59:11,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-24 02:59:11,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure e9e0055cfc0fdca7d346e5147caffebc, server=jenkins-hbase20.apache.org,37585,1695524344064 in 212 msec 2023-09-24 02:59:11,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-24 02:59:11,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 688715887ac9a18be6ddc5a39815e741, server=jenkins-hbase20.apache.org,38603,1695524343980 in 218 msec 2023-09-24 02:59:11,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e9e0055cfc0fdca7d346e5147caffebc, ASSIGN in 381 msec 2023-09-24 02:59:11,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-24 02:59:11,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=688715887ac9a18be6ddc5a39815e741, ASSIGN in 384 msec 2023-09-24 02:59:11,655 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 02:59:11,655 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524351655"}]},"ts":"1695524351655"} 2023-09-24 02:59:11,657 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-24 02:59:11,660 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 02:59:11,665 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-24 02:59:11,682 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 02:59:11,707 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:11,707 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:11,707 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:11,707 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:11,708 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 02:59:11,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:11,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:11,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:11,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:11,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 600 msec 2023-09-24 02:59:11,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 02:59:11,728 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-24 02:59:11,732 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-24 02:59:11,733 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,735 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 02:59:11,761 DEBUG [hconnection-0x182ba710-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:11,767 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:11,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 02:59:11,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524351786 (current time:1695524351786). 2023-09-24 02:59:11,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 02:59:11,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x4486427f to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:11,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61f4dabb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:11,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:11,799 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:11,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4486427f to 127.0.0.1:50111 2023-09-24 02:59:11,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:11,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x3778785e to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:11,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@96198a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:11,811 DEBUG [hconnection-0x6426a978-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:11,812 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:11,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3778785e to 127.0.0.1:50111 2023-09-24 02:59:11,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:11,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 02:59:11,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 02:59:11,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 02:59:11,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 02:59:11,858 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 02:59:11,859 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695524951859 2023-09-24 02:59:11,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 02:59:11,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-24 02:59:11,864 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 02:59:11,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 02:59:11,866 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 02:59:11,867 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 02:59:11,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-24 02:59:11,870 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 02:59:11,871 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695524951871 2023-09-24 02:59:11,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,906 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-24 02:59:11,906 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:11,907 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-24 02:59:11,907 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-24 02:59:11,908 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,908 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,911 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:11,911 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:11,911 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:11,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:11,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:11,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:11,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:11,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:11,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:11,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,912 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,912 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 02:59:11,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 02:59:11,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 02:59:11,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 02:59:11,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 02:59:11,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 02:59:11,914 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 02:59:11,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,917 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 02:59:11,917 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 02:59:11,917 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 02:59:11,917 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:11,917 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:11,917 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:11,918 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 02:59:11,919 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 02:59:11,918 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 02:59:11,919 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 02:59:11,919 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 02:59:11,919 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 02:59:11,919 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 02:59:11,919 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 02:59:11,919 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 02:59:11,925 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,925 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,925 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,925 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,925 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:11,926 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:11,926 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,926 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:11,926 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,926 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:11,926 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:11,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-24 02:59:11,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33776528[Count = 1] remaining members to acquire global barrier 2023-09-24 02:59:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:11,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-24 02:59:11,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33776528[Count = 0] remaining members to acquire global barrier 2023-09-24 02:59:11,931 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-24 02:59:11,931 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 02:59:11,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 02:59:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,933 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 02:59:11,933 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 02:59:11,933 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,933 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 02:59:11,933 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 02:59:11,934 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:11,934 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:11,934 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,935 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. started... 2023-09-24 02:59:11,942 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:11,943 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:11,943 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,944 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. started... 2023-09-24 02:59:11,944 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 02:59:11,944 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:11,944 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 02:59:11,946 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 688715887ac9a18be6ddc5a39815e741: 2023-09-24 02:59:11,946 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9e0055cfc0fdca7d346e5147caffebc: 2023-09-24 02:59:11,947 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,947 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:11,951 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:11,951 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:11,954 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 02:59:11,954 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 02:59:11,967 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:11,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 02:59:11,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 02:59:11,973 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 02:59:11,993 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. completed. 2023-09-24 02:59:11,994 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:11,994 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:11,994 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:11,994 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. completed. 2023-09-24 02:59:11,994 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,994 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:11,995 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 02:59:11,995 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:11,995 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:11,995 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,995 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 02:59:11,995 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 02:59:11,995 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 02:59:11,996 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,996 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 02:59:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:11,996 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:11,996 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:11,996 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 02:59:11,996 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 02:59:11,997 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:11,997 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 02:59:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,37585,1695524344064': 2023-09-24 02:59:12,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-24 02:59:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:12,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:12,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:12,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 02:59:12,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-24 02:59:12,007 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-24 02:59:12,007 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 02:59:12,007 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 02:59:12,007 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,007 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 02:59:12,013 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:12,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,013 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,013 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,013 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,014 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:12,014 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:12,016 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,017 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,017 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,028 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,028 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,028 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,028 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,028 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,028 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,028 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-24 02:59:12,029 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:12,029 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,029 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,030 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,030 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 02:59:12,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,030 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,030 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,031 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,031 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,031 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,031 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 02:59:12,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,105 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-24 02:59:12,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,105 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:12,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695524351860Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695524352053 (+193 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695524352053Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695524352054 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695524352067 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695524352092 (+25 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695524352105 (+13 ms) 2023-09-24 02:59:12,108 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 02:59:12,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 246 msec 2023-09-24 02:59:12,174 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:12,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 02:59:12,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 02:59:12,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38603] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 02:59:12,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37585] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 02:59:12,201 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-24 02:59:12,201 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:12,202 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 02:59:12,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 02:59:12,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524352220 (current time:1695524352220). 2023-09-24 02:59:12,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 02:59:12,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x6f92f64c to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:12,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f5ad67b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:12,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:12,231 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:12,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f92f64c to 127.0.0.1:50111 2023-09-24 02:59:12,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:12,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x43455962 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:12,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b1de7d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:12,240 DEBUG [hconnection-0x622d07c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:12,243 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:12,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43455962 to 127.0.0.1:50111 2023-09-24 02:59:12,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:12,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 02:59:12,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 02:59:12,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 02:59:12,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 02:59:12,255 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 02:59:12,256 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695524952256 2023-09-24 02:59:12,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 02:59:12,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-24 02:59:12,258 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 02:59:12,258 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 02:59:12,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 02:59:12,260 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 02:59:12,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-09-24 02:59:12,263 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 02:59:12,264 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695524952264 2023-09-24 02:59:12,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-24 02:59:12,280 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-24 02:59:12,280 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:12,281 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-24 02:59:12,281 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-24 02:59:12,282 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,282 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,283 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,283 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,283 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,283 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,283 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,283 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,284 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,284 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 02:59:12,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 02:59:12,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 02:59:12,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 02:59:12,285 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 02:59:12,285 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:12,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 02:59:12,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 02:59:12,289 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 02:59:12,289 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 02:59:12,289 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:12,289 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 02:59:12,289 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:12,289 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 02:59:12,289 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 02:59:12,290 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 02:59:12,290 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 02:59:12,290 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 02:59:12,290 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 02:59:12,290 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 02:59:12,290 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 02:59:12,300 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,300 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,300 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,300 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,300 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:12,300 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:12,300 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,300 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,301 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:12,301 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,301 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:12,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-24 02:59:12,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e7c913e[Count = 1] remaining members to acquire global barrier 2023-09-24 02:59:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:12,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-24 02:59:12,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e7c913e[Count = 0] remaining members to acquire global barrier 2023-09-24 02:59:12,305 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-24 02:59:12,305 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,313 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,313 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,313 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 02:59:12,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 02:59:12,314 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:12,314 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,314 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:12,314 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 02:59:12,314 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. started... 2023-09-24 02:59:12,314 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:12,314 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:12,314 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. started... 2023-09-24 02:59:12,314 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 688715887ac9a18be6ddc5a39815e741 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-24 02:59:12,315 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e9e0055cfc0fdca7d346e5147caffebc 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-24 02:59:12,318 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 02:59:12,318 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:12,318 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 02:59:12,358 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:12,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 02:59:12,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 02:59:12,360 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 02:59:12,432 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309240201bcaf94124925a710489efd2c316a to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309240201bcaf94124925a710489efd2c316a 2023-09-24 02:59:12,432 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924553160b6def641c782e3a3b97bbbce5f to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924553160b6def641c782e3a3b97bbbce5f 2023-09-24 02:59:12,463 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/.tmp/cf/93e93885c8424428840a80995c7844c0 2023-09-24 02:59:12,463 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/.tmp/cf/d5026a8822324e948541ea729c5f9b95 2023-09-24 02:59:12,474 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/.tmp/cf/d5026a8822324e948541ea729c5f9b95 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf/d5026a8822324e948541ea729c5f9b95 2023-09-24 02:59:12,474 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/.tmp/cf/93e93885c8424428840a80995c7844c0 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf/93e93885c8424428840a80995c7844c0 2023-09-24 02:59:12,483 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf/93e93885c8424428840a80995c7844c0, entries=1, sequenceid=6, filesize=5.1 K 2023-09-24 02:59:12,483 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf/d5026a8822324e948541ea729c5f9b95, entries=49, sequenceid=6, filesize=13.1 K 2023-09-24 02:59:12,487 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 688715887ac9a18be6ddc5a39815e741 in 173ms, sequenceid=6, compaction requested=false 2023-09-24 02:59:12,487 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for e9e0055cfc0fdca7d346e5147caffebc in 173ms, sequenceid=6, compaction requested=false 2023-09-24 02:59:12,487 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-24 02:59:12,487 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-24 02:59:12,490 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9e0055cfc0fdca7d346e5147caffebc: 2023-09-24 02:59:12,490 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 688715887ac9a18be6ddc5a39815e741: 2023-09-24 02:59:12,490 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 02:59:12,490 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 02:59:12,490 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:12,490 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:12,491 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf/93e93885c8424428840a80995c7844c0] hfiles 2023-09-24 02:59:12,491 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf/d5026a8822324e948541ea729c5f9b95] hfiles 2023-09-24 02:59:12,491 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf/93e93885c8424428840a80995c7844c0 for snapshot=snaptb0-testExportWithTargetName 2023-09-24 02:59:12,491 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf/d5026a8822324e948541ea729c5f9b95 for snapshot=snaptb0-testExportWithTargetName 2023-09-24 02:59:12,516 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. completed. 2023-09-24 02:59:12,516 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:12,516 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. completed. 2023-09-24 02:59:12,516 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:12,516 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:12,516 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,516 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:12,517 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 02:59:12,517 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:12,517 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 02:59:12,517 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:12,517 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,517 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 02:59:12,517 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 02:59:12,518 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,518 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 02:59:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:12,518 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:12,518 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 02:59:12,520 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 02:59:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:12,520 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,520 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:12,520 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 02:59:12,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:12,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 02:59:12,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-24 02:59:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,37585,1695524344064': 2023-09-24 02:59:12,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-24 02:59:12,528 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-24 02:59:12,528 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 02:59:12,528 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 02:59:12,528 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-24 02:59:12,528 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 02:59:12,542 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:12,542 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,542 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,543 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,543 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:12,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:12,545 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 02:59:12,546 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,546 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,556 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,556 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,557 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,556 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-24 02:59:12,556 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:12,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-24 02:59:12,557 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:12,557 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,557 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:12,557 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:12,557 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,558 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 02:59:12,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:12,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 02:59:12,559 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,559 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:12,559 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,559 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:12,559 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:12,559 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,559 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:12,560 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:12,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309240201bcaf94124925a710489efd2c316a, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924553160b6def641c782e3a3b97bbbce5f] mob files 2023-09-24 02:59:12,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309240201bcaf94124925a710489efd2c316a 2023-09-24 02:59:12,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924553160b6def641c782e3a3b97bbbce5f 2023-09-24 02:59:12,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 02:59:12,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 02:59:12,563 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-24 02:59:12,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-24 02:59:12,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-24 02:59:12,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,618 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 02:59:12,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695524352256Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695524352576 (+320 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695524352576Loading Region manifests for snaptb0-testExportWithTargetName at 1695524352576Writing data manifest for snaptb0-testExportWithTargetName at 1695524352580 (+4 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695524352604 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695524352617 (+13 ms) 2023-09-24 02:59:12,620 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 02:59:12,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 363 msec 2023-09-24 02:59:12,863 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:12,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 02:59:12,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 02:59:12,866 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866 2023-09-24 02:59:12,867 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42749, tgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866, rawTgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866, srcFsUri=hdfs://localhost:42749, srcDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:12,905 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:12,905 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-807377100_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-24 02:59:12,905 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f, snapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-24 02:59:12,928 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-24 02:59:13,001 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,001 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,002 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,003 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,005 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 02:59:13,007 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-24 02:59:13,007 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 02:59:13,007 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-24 02:59:13,008 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-24 02:59:13,008 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-24 02:59:13,008 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 02:59:13,008 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-24 02:59:13,008 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-24 02:59:13,008 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-24 02:59:13,789 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-1443406616955889682.jar 2023-09-24 02:59:13,789 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,790 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,853 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-2209630776491977280.jar 2023-09-24 02:59:13,853 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,854 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,854 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,855 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,855 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,855 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:13,856 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 02:59:13,856 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 02:59:13,856 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 02:59:13,857 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 02:59:13,857 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 02:59:13,858 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 02:59:13,858 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 02:59:13,858 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 02:59:13,859 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 02:59:13,859 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 02:59:13,862 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:13,863 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:13,863 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:13,864 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:13,864 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:13,864 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:13,865 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:14,594 WARN [Listener at jenkins-hbase20.apache.org/38347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 02:59:14,601 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-24 02:59:14,611 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-24 02:59:15,011 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 02:59:15,011 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 02:59:15,165 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0001_000001 (auth:SIMPLE) 2023-09-24 02:59:17,104 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 02:59:19,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0001_000001 (auth:SIMPLE) 2023-09-24 02:59:21,371 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0001_000001 (auth:SIMPLE) 2023-09-24 02:59:25,429 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 02:59:25,432 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 02:59:25,443 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-24 02:59:25,443 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 02:59:25,444 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 02:59:25,444 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-24 02:59:25,444 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-24 02:59:25,444 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-24 02:59:25,444 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866/.hbase-snapshot/testExportWithTargetName 2023-09-24 02:59:25,445 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-24 02:59:25,445 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524352866/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-24 02:59:25,456 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-24 02:59:25,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-09-24 02:59:25,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-24 02:59:25,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524365472"}]},"ts":"1695524365472"} 2023-09-24 02:59:25,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 02:59:25,475 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-24 02:59:25,476 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-24 02:59:25,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=688715887ac9a18be6ddc5a39815e741, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e9e0055cfc0fdca7d346e5147caffebc, UNASSIGN}] 2023-09-24 02:59:25,481 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=688715887ac9a18be6ddc5a39815e741, UNASSIGN 2023-09-24 02:59:25,481 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e9e0055cfc0fdca7d346e5147caffebc, UNASSIGN 2023-09-24 02:59:25,482 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=688715887ac9a18be6ddc5a39815e741, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:25,482 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e9e0055cfc0fdca7d346e5147caffebc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:25,483 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524365482"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524365482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524365482"}]},"ts":"1695524365482"} 2023-09-24 02:59:25,483 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524365482"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524365482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524365482"}]},"ts":"1695524365482"} 2023-09-24 02:59:25,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 688715887ac9a18be6ddc5a39815e741, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 02:59:25,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure e9e0055cfc0fdca7d346e5147caffebc, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 02:59:25,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 02:59:25,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:25,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e9e0055cfc0fdca7d346e5147caffebc, disabling compactions & flushes 2023-09-24 02:59:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 688715887ac9a18be6ddc5a39815e741, disabling compactions & flushes 2023-09-24 02:59:25,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:25,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. after waiting 0 ms 2023-09-24 02:59:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. after waiting 0 ms 2023-09-24 02:59:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:25,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 02:59:25,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 02:59:25,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 02:59:25,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 02:59:25,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc. 2023-09-24 02:59:25,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e9e0055cfc0fdca7d346e5147caffebc: 2023-09-24 02:59:25,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741. 2023-09-24 02:59:25,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 688715887ac9a18be6ddc5a39815e741: 2023-09-24 02:59:25,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:25,668 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e9e0055cfc0fdca7d346e5147caffebc, regionState=CLOSED 2023-09-24 02:59:25,668 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524365668"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524365668"}]},"ts":"1695524365668"} 2023-09-24 02:59:25,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:25,669 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=688715887ac9a18be6ddc5a39815e741, regionState=CLOSED 2023-09-24 02:59:25,669 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695524365669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524365669"}]},"ts":"1695524365669"} 2023-09-24 02:59:25,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-24 02:59:25,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure e9e0055cfc0fdca7d346e5147caffebc, server=jenkins-hbase20.apache.org,37585,1695524344064 in 184 msec 2023-09-24 02:59:25,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-24 02:59:25,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 688715887ac9a18be6ddc5a39815e741, server=jenkins-hbase20.apache.org,38603,1695524343980 in 186 msec 2023-09-24 02:59:25,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e9e0055cfc0fdca7d346e5147caffebc, UNASSIGN in 194 msec 2023-09-24 02:59:25,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-24 02:59:25,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=688715887ac9a18be6ddc5a39815e741, UNASSIGN in 195 msec 2023-09-24 02:59:25,676 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524365676"}]},"ts":"1695524365676"} 2023-09-24 02:59:25,678 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-24 02:59:25,679 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-24 02:59:25,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 219 msec 2023-09-24 02:59:25,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 02:59:25,776 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-24 02:59:25,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-09-24 02:59:25,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 02:59:25,790 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 02:59:25,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-24 02:59:25,792 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 02:59:25,795 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-24 02:59:25,797 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 02:59:25,797 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 02:59:25,797 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 02:59:25,798 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 02:59:25,798 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:25,799 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:25,799 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:25,799 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:25,799 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:25,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-24 02:59:25,803 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:25,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 02:59:25,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 02:59:25,804 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 02:59:25,804 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 02:59:25,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 02:59:25,805 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 02:59:25,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 02:59:25,805 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 02:59:25,807 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/recovered.edits] 2023-09-24 02:59:25,807 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/recovered.edits] 2023-09-24 02:59:25,814 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf/93e93885c8424428840a80995c7844c0 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/cf/93e93885c8424428840a80995c7844c0 2023-09-24 02:59:25,815 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf/d5026a8822324e948541ea729c5f9b95 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/cf/d5026a8822324e948541ea729c5f9b95 2023-09-24 02:59:25,819 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741/recovered.edits/9.seqid 2023-09-24 02:59:25,819 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc/recovered.edits/9.seqid 2023-09-24 02:59:25,819 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/688715887ac9a18be6ddc5a39815e741 2023-09-24 02:59:25,819 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportWithTargetName/e9e0055cfc0fdca7d346e5147caffebc 2023-09-24 02:59:25,820 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-24 02:59:25,820 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-24 02:59:25,821 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-24 02:59:25,825 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309240201bcaf94124925a710489efd2c316a to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309240201bcaf94124925a710489efd2c316a 2023-09-24 02:59:25,827 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924553160b6def641c782e3a3b97bbbce5f to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924553160b6def641c782e3a3b97bbbce5f 2023-09-24 02:59:25,828 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-24 02:59:25,831 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 02:59:25,850 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-24 02:59:25,853 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-24 02:59:25,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 02:59:25,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-24 02:59:25,855 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524365855"}]},"ts":"9223372036854775807"} 2023-09-24 02:59:25,855 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524365855"}]},"ts":"9223372036854775807"} 2023-09-24 02:59:25,857 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 02:59:25,857 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 688715887ac9a18be6ddc5a39815e741, NAME => 'testtb-testExportWithTargetName,,1695524351113.688715887ac9a18be6ddc5a39815e741.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e9e0055cfc0fdca7d346e5147caffebc, NAME => 'testtb-testExportWithTargetName,1,1695524351113.e9e0055cfc0fdca7d346e5147caffebc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 02:59:25,857 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-24 02:59:25,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695524365857"}]},"ts":"9223372036854775807"} 2023-09-24 02:59:25,860 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-24 02:59:25,862 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 02:59:25,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 80 msec 2023-09-24 02:59:25,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-24 02:59:25,906 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-24 02:59:25,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-24 02:59:25,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-24 02:59:25,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-09-24 02:59:25,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-24 02:59:25,968 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 704) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:55424 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:38347 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:37373 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:46822 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:43613 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:60400 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1709389546_1 at /127.0.0.1:55400 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1709389546_1 at /127.0.0.1:60362 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:46017 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=934 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=217 (was 213) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=7016 (was 7897) 2023-09-24 02:59:25,969 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-24 02:59:25,990 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=217, ProcessCount=172, AvailableMemoryMB=7015 2023-09-24 02:59:25,991 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-24 02:59:25,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 02:59:25,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-24 02:59:25,999 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 02:59:26,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-24 02:59:26,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 02:59:26,002 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 02:59:26,005 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,005 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,006 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc empty. 2023-09-24 02:59:26,006 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64 empty. 2023-09-24 02:59:26,006 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,006 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,007 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-24 02:59:26,018 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-24 02:59:26,020 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ee7b1b5442d1ecb3592850a35729cb64, NAME => 'testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 02:59:26,020 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => adfd1b908559471ab3375f0cd818d4fc, NAME => 'testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 02:59:26,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:26,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing adfd1b908559471ab3375f0cd818d4fc, disabling compactions & flushes 2023-09-24 02:59:26,040 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. after waiting 0 ms 2023-09-24 02:59:26,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,041 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for adfd1b908559471ab3375f0cd818d4fc: 2023-09-24 02:59:26,041 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:26,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ee7b1b5442d1ecb3592850a35729cb64, disabling compactions & flushes 2023-09-24 02:59:26,042 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. after waiting 0 ms 2023-09-24 02:59:26,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,042 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,042 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ee7b1b5442d1ecb3592850a35729cb64: 2023-09-24 02:59:26,045 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 02:59:26,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524366046"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524366046"}]},"ts":"1695524366046"} 2023-09-24 02:59:26,047 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524366046"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524366046"}]},"ts":"1695524366046"} 2023-09-24 02:59:26,050 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 02:59:26,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 02:59:26,054 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524366054"}]},"ts":"1695524366054"} 2023-09-24 02:59:26,056 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-24 02:59:26,059 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 02:59:26,060 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 02:59:26,060 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 02:59:26,060 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 02:59:26,060 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 02:59:26,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adfd1b908559471ab3375f0cd818d4fc, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ee7b1b5442d1ecb3592850a35729cb64, ASSIGN}] 2023-09-24 02:59:26,064 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ee7b1b5442d1ecb3592850a35729cb64, ASSIGN 2023-09-24 02:59:26,064 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adfd1b908559471ab3375f0cd818d4fc, ASSIGN 2023-09-24 02:59:26,065 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ee7b1b5442d1ecb3592850a35729cb64, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38603,1695524343980; forceNewPlan=false, retain=false 2023-09-24 02:59:26,065 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adfd1b908559471ab3375f0cd818d4fc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37585,1695524344064; forceNewPlan=false, retain=false 2023-09-24 02:59:26,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 02:59:26,215 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 02:59:26,218 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=adfd1b908559471ab3375f0cd818d4fc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,218 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ee7b1b5442d1ecb3592850a35729cb64, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,218 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524366218"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524366218"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524366218"}]},"ts":"1695524366218"} 2023-09-24 02:59:26,218 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524366218"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524366218"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524366218"}]},"ts":"1695524366218"} 2023-09-24 02:59:26,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure ee7b1b5442d1ecb3592850a35729cb64, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 02:59:26,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure adfd1b908559471ab3375f0cd818d4fc, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 02:59:26,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 02:59:26,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ee7b1b5442d1ecb3592850a35729cb64, NAME => 'testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 02:59:26,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => adfd1b908559471ab3375f0cd818d4fc, NAME => 'testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 02:59:26,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. service=AccessControlService 2023-09-24 02:59:26,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:26,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:26,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. service=AccessControlService 2023-09-24 02:59:26,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:26,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:26,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,381 INFO [StoreOpener-ee7b1b5442d1ecb3592850a35729cb64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,381 INFO [StoreOpener-adfd1b908559471ab3375f0cd818d4fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,382 DEBUG [StoreOpener-ee7b1b5442d1ecb3592850a35729cb64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf 2023-09-24 02:59:26,382 DEBUG [StoreOpener-ee7b1b5442d1ecb3592850a35729cb64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf 2023-09-24 02:59:26,382 DEBUG [StoreOpener-adfd1b908559471ab3375f0cd818d4fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf 2023-09-24 02:59:26,382 DEBUG [StoreOpener-adfd1b908559471ab3375f0cd818d4fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf 2023-09-24 02:59:26,382 INFO [StoreOpener-ee7b1b5442d1ecb3592850a35729cb64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee7b1b5442d1ecb3592850a35729cb64 columnFamilyName cf 2023-09-24 02:59:26,382 INFO [StoreOpener-adfd1b908559471ab3375f0cd818d4fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adfd1b908559471ab3375f0cd818d4fc columnFamilyName cf 2023-09-24 02:59:26,384 INFO [StoreOpener-adfd1b908559471ab3375f0cd818d4fc-1] regionserver.HStore(310): Store=adfd1b908559471ab3375f0cd818d4fc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:26,384 INFO [StoreOpener-ee7b1b5442d1ecb3592850a35729cb64-1] regionserver.HStore(310): Store=ee7b1b5442d1ecb3592850a35729cb64/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:26,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:26,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:26,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:26,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:26,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ee7b1b5442d1ecb3592850a35729cb64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67921378, jitterRate=0.012107402086257935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:26,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened adfd1b908559471ab3375f0cd818d4fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60262216, jitterRate=-0.10202300548553467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:26,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ee7b1b5442d1ecb3592850a35729cb64: 2023-09-24 02:59:26,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for adfd1b908559471ab3375f0cd818d4fc: 2023-09-24 02:59:26,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64., pid=30, masterSystemTime=1695524366374 2023-09-24 02:59:26,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc., pid=31, masterSystemTime=1695524366376 2023-09-24 02:59:26,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,396 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=adfd1b908559471ab3375f0cd818d4fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,396 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524366396"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524366396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524366396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524366396"}]},"ts":"1695524366396"} 2023-09-24 02:59:26,397 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ee7b1b5442d1ecb3592850a35729cb64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,397 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524366397"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524366397"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524366397"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524366397"}]},"ts":"1695524366397"} 2023-09-24 02:59:26,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-24 02:59:26,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure adfd1b908559471ab3375f0cd818d4fc, server=jenkins-hbase20.apache.org,37585,1695524344064 in 175 msec 2023-09-24 02:59:26,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-24 02:59:26,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adfd1b908559471ab3375f0cd818d4fc, ASSIGN in 341 msec 2023-09-24 02:59:26,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure ee7b1b5442d1ecb3592850a35729cb64, server=jenkins-hbase20.apache.org,38603,1695524343980 in 178 msec 2023-09-24 02:59:26,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-24 02:59:26,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ee7b1b5442d1ecb3592850a35729cb64, ASSIGN in 344 msec 2023-09-24 02:59:26,409 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 02:59:26,409 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524366409"}]},"ts":"1695524366409"} 2023-09-24 02:59:26,410 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-24 02:59:26,413 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 02:59:26,413 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-24 02:59:26,415 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 02:59:26,416 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:26,416 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:26,416 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:26,417 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:26,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:26,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:26,418 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:26,418 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:26,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 423 msec 2023-09-24 02:59:26,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 02:59:26,607 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-24 02:59:26,610 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-24 02:59:26,610 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,613 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 02:59:26,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 02:59:26,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524366628 (current time:1695524366628). 2023-09-24 02:59:26,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 02:59:26,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x435f1673 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:26,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3641f601, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:26,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:26,643 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:26,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x435f1673 to 127.0.0.1:50111 2023-09-24 02:59:26,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:26,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x4ef5c087 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:26,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7522bba4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:26,660 DEBUG [hconnection-0x4c6aaaff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:26,664 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:26,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ef5c087 to 127.0.0.1:50111 2023-09-24 02:59:26,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:26,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 02:59:26,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 02:59:26,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 02:59:26,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 02:59:26,681 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 02:59:26,682 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695524966682 2023-09-24 02:59:26,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-24 02:59:26,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 02:59:26,684 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 02:59:26,684 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 02:59:26,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 02:59:26,686 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 02:59:26,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-24 02:59:26,691 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 02:59:26,692 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695524966692 2023-09-24 02:59:26,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,714 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-24 02:59:26,714 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:26,716 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-24 02:59:26,716 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-24 02:59:26,716 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,716 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,717 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:26,717 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:26,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:26,717 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:26,717 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:26,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:26,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:26,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,718 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,718 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,718 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,718 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 02:59:26,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 02:59:26,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,719 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 02:59:26,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 02:59:26,719 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 02:59:26,719 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:26,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,721 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 02:59:26,721 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 02:59:26,721 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 02:59:26,721 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 02:59:26,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,722 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 02:59:26,722 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:26,723 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 02:59:26,724 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 02:59:26,724 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,724 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,724 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 02:59:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 02:59:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,724 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,724 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:26,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 02:59:26,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,725 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 02:59:26,725 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:26,726 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 02:59:26,726 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 02:59:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:26,726 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 02:59:26,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:26,727 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,727 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,727 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:26,728 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,728 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,728 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,728 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:26,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:26,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-24 02:59:26,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e174993[Count = 1] remaining members to acquire global barrier 2023-09-24 02:59:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:26,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-24 02:59:26,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e174993[Count = 0] remaining members to acquire global barrier 2023-09-24 02:59:26,731 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 02:59:26,731 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 02:59:26,732 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 02:59:26,732 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 02:59:26,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,732 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 02:59:26,732 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 02:59:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,732 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 02:59:26,734 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:26,734 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,734 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:26,734 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 02:59:26,734 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. started... 2023-09-24 02:59:26,734 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:26,734 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 02:59:26,735 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for adfd1b908559471ab3375f0cd818d4fc: 2023-09-24 02:59:26,735 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,735 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:26,735 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 02:59:26,738 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:26,740 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,740 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:26,740 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. started... 2023-09-24 02:59:26,741 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ee7b1b5442d1ecb3592850a35729cb64: 2023-09-24 02:59:26,742 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,742 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:26,742 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 02:59:26,760 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. completed. 2023-09-24 02:59:26,760 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,760 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:26,760 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:26,760 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,760 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 02:59:26,760 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 02:59:26,760 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. completed. 2023-09-24 02:59:26,760 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:26,760 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:26,761 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:26,761 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,761 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 02:59:26,761 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 02:59:26,766 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 02:59:26,766 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,766 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 02:59:26,766 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,766 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:26,766 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:26,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:26,766 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 02:59:26,766 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 02:59:26,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:26,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:26,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:26,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 02:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 02:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,37585,1695524344064': 2023-09-24 02:59:26,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 02:59:26,776 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-24 02:59:26,776 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 02:59:26,776 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 02:59:26,776 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,776 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 02:59:26,779 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:26,779 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:26,779 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,779 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:26,779 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:26,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,780 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,782 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:26,782 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,782 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,785 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:26,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 02:59:26,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 02:59:26,786 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:26,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:26,791 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:26,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:26,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:26,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,791 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,793 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-24 02:59:26,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:26,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:26,793 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 02:59:26,793 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:26,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:26,794 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:26,794 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:26,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:26,794 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:26,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:26,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 02:59:26,794 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,794 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-24 02:59:26,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,837 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:26,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695524366682Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695524366807 (+125 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695524366807Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695524366807Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695524366811 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695524366827 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695524366836 (+9 ms) 2023-09-24 02:59:26,839 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 02:59:26,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 156 msec 2023-09-24 02:59:26,986 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:26,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 02:59:26,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 02:59:26,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37585] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 02:59:26,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38603] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 02:59:26,999 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-24 02:59:26,999 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:26,999 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 02:59:27,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 02:59:27,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524367013 (current time:1695524367013). 2023-09-24 02:59:27,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 02:59:27,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x6c1f85da to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:27,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35df844e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:27,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:27,025 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:27,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c1f85da to 127.0.0.1:50111 2023-09-24 02:59:27,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:27,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x2e6f975b to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:27,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77fae87a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:27,036 DEBUG [hconnection-0x349293af-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:27,037 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:27,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e6f975b to 127.0.0.1:50111 2023-09-24 02:59:27,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:27,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 02:59:27,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 02:59:27,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 02:59:27,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 02:59:27,049 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 02:59:27,050 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695524967050 2023-09-24 02:59:27,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 02:59:27,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-24 02:59:27,052 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 02:59:27,052 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 02:59:27,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 02:59:27,054 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 02:59:27,058 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-24 02:59:27,059 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 02:59:27,060 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695524967060 2023-09-24 02:59:27,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-24 02:59:27,071 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-24 02:59:27,071 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:27,072 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-24 02:59:27,072 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-24 02:59:27,073 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,073 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,073 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:27,073 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,073 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:27,073 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:27,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:27,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:27,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:27,074 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:27,074 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,074 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,074 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 02:59:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 02:59:27,075 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 02:59:27,075 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:27,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 02:59:27,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 02:59:27,077 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 02:59:27,077 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 02:59:27,077 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:27,077 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 02:59:27,078 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 02:59:27,078 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 02:59:27,078 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 02:59:27,078 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 02:59:27,078 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 02:59:27,077 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:27,080 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 02:59:27,080 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 02:59:27,080 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 02:59:27,087 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,087 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:27,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:27,091 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:27,091 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,091 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:27,091 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,091 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:27,091 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,091 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:27,091 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,091 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46413b5c[Count = 1] remaining members to acquire global barrier 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:27,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-24 02:59:27,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46413b5c[Count = 0] remaining members to acquire global barrier 2023-09-24 02:59:27,094 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 02:59:27,094 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,095 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,095 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,095 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,095 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 02:59:27,095 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,096 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 02:59:27,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,096 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 02:59:27,096 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 02:59:27,096 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,096 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 02:59:27,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,096 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 02:59:27,096 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:27,096 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:27,096 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:27,096 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. started... 2023-09-24 02:59:27,096 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:27,096 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:27,096 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:27,096 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. started... 2023-09-24 02:59:27,096 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ee7b1b5442d1ecb3592850a35729cb64 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-24 02:59:27,097 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2745): Flushing adfd1b908559471ab3375f0cd818d4fc 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-24 02:59:27,097 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 02:59:27,097 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:27,097 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 02:59:27,134 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924eea3f3988741406789f069a6439fa4be to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924eea3f3988741406789f069a6439fa4be 2023-09-24 02:59:27,136 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924f86c2a754ae346d8bac98ca024281dc7 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f86c2a754ae346d8bac98ca024281dc7 2023-09-24 02:59:27,152 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:27,163 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/.tmp/cf/ceff6e9b65d74bc4b6205e2144309912 2023-09-24 02:59:27,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 02:59:27,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 02:59:27,165 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 02:59:27,166 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/.tmp/cf/34ccfc9a8585434a871f6fb046118b09 2023-09-24 02:59:27,172 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/.tmp/cf/34ccfc9a8585434a871f6fb046118b09 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf/34ccfc9a8585434a871f6fb046118b09 2023-09-24 02:59:27,172 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/.tmp/cf/ceff6e9b65d74bc4b6205e2144309912 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf/ceff6e9b65d74bc4b6205e2144309912 2023-09-24 02:59:27,178 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf/34ccfc9a8585434a871f6fb046118b09, entries=5, sequenceid=6, filesize=5.7 K 2023-09-24 02:59:27,182 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf/ceff6e9b65d74bc4b6205e2144309912, entries=45, sequenceid=6, filesize=12.5 K 2023-09-24 02:59:27,183 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for adfd1b908559471ab3375f0cd818d4fc in 86ms, sequenceid=6, compaction requested=false 2023-09-24 02:59:27,183 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-24 02:59:27,183 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ee7b1b5442d1ecb3592850a35729cb64 in 87ms, sequenceid=6, compaction requested=false 2023-09-24 02:59:27,183 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ee7b1b5442d1ecb3592850a35729cb64: 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for adfd1b908559471ab3375f0cd818d4fc: 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf/ceff6e9b65d74bc4b6205e2144309912] hfiles 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf/ceff6e9b65d74bc4b6205e2144309912 for snapshot=snaptb0-testExportFileSystemState 2023-09-24 02:59:27,187 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf/34ccfc9a8585434a871f6fb046118b09] hfiles 2023-09-24 02:59:27,188 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf/34ccfc9a8585434a871f6fb046118b09 for snapshot=snaptb0-testExportFileSystemState 2023-09-24 02:59:27,199 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. completed. 2023-09-24 02:59:27,199 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:27,199 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. completed. 2023-09-24 02:59:27,199 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:27,199 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:27,199 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:27,199 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,199 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 02:59:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 02:59:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 02:59:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 02:59:27,202 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 02:59:27,202 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,202 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:27,202 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 02:59:27,203 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 02:59:27,203 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,203 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:27,204 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 02:59:27,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 02:59:27,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 02:59:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,37585,1695524344064': 2023-09-24 02:59:27,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 02:59:27,211 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-24 02:59:27,211 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 02:59:27,211 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 02:59:27,211 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-24 02:59:27,211 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 02:59:27,216 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,216 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,216 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,216 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:27,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,216 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:27,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,216 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,217 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:27,217 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:27,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:27,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,218 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:27,218 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 02:59:27,220 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,221 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,221 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,224 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,224 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:27,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:27,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:27,224 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,224 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:27,224 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:27,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:27,224 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-24 02:59:27,224 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,226 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,226 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-24 02:59:27,226 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:27,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 02:59:27,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 02:59:27,226 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:27,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:27,226 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:27,226 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:27,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:27,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:27,227 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:27,227 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,227 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:27,227 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:27,227 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,227 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f86c2a754ae346d8bac98ca024281dc7, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924eea3f3988741406789f069a6439fa4be] mob files 2023-09-24 02:59:27,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f86c2a754ae346d8bac98ca024281dc7 2023-09-24 02:59:27,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924eea3f3988741406789f069a6439fa4be 2023-09-24 02:59:27,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:27,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-24 02:59:27,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-24 02:59:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,264 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695524367050Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695524367237 (+187 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695524367237Loading Region manifests for snaptb0-testExportFileSystemState at 1695524367237Writing data manifest for snaptb0-testExportFileSystemState at 1695524367241 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695524367255 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695524367264 (+9 ms) 2023-09-24 02:59:27,267 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 02:59:27,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 215 msec 2023-09-24 02:59:27,366 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:27,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 02:59:27,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 02:59:27,367 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367 2023-09-24 02:59:27,367 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42749, tgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367, rawTgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367, srcFsUri=hdfs://localhost:42749, srcDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:27,388 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:27,388 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1948678115_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,388 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f, snapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-24 02:59:27,404 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 02:59:27,434 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:27,435 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:27,435 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:27,436 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,179 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-6730010474671717755.jar 2023-09-24 02:59:28,180 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,180 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,240 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-3808328601972372640.jar 2023-09-24 02:59:28,240 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,241 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,241 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,241 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,242 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,242 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:28,242 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 02:59:28,243 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 02:59:28,243 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 02:59:28,243 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 02:59:28,244 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 02:59:28,244 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 02:59:28,244 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 02:59:28,245 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 02:59:28,245 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 02:59:28,246 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 02:59:28,246 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:28,246 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:28,247 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:28,247 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:28,247 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:28,248 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:28,248 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:28,738 WARN [Listener at jenkins-hbase20.apache.org/38347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 02:59:28,740 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-24 02:59:28,743 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-24 02:59:30,455 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 02:59:30,455 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 02:59:30,461 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0001_000001 (auth:SIMPLE) 2023-09-24 02:59:31,235 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0002_000001 (auth:SIMPLE) 2023-09-24 02:59:31,242 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 02:59:34,779 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0002_000001 (auth:SIMPLE) 2023-09-24 02:59:37,003 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0002_000001 (auth:SIMPLE) 2023-09-24 02:59:39,173 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0002_000001 (auth:SIMPLE) 2023-09-24 02:59:41,012 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 02:59:41,012 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 02:59:41,023 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-24 02:59:41,023 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 02:59:41,024 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 02:59:41,024 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 02:59:41,024 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-24 02:59:41,024 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-24 02:59:41,024 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 02:59:41,025 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-24 02:59:41,025 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524367367/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-24 02:59:41,033 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-24 02:59:41,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-09-24 02:59:41,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-24 02:59:41,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 02:59:41,038 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524381038"}]},"ts":"1695524381038"} 2023-09-24 02:59:41,040 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-24 02:59:41,042 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-24 02:59:41,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adfd1b908559471ab3375f0cd818d4fc, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ee7b1b5442d1ecb3592850a35729cb64, UNASSIGN}] 2023-09-24 02:59:41,045 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ee7b1b5442d1ecb3592850a35729cb64, UNASSIGN 2023-09-24 02:59:41,045 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adfd1b908559471ab3375f0cd818d4fc, UNASSIGN 2023-09-24 02:59:41,046 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=adfd1b908559471ab3375f0cd818d4fc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:41,046 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ee7b1b5442d1ecb3592850a35729cb64, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:41,047 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524381046"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524381046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524381046"}]},"ts":"1695524381046"} 2023-09-24 02:59:41,047 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524381046"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524381046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524381046"}]},"ts":"1695524381046"} 2023-09-24 02:59:41,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure ee7b1b5442d1ecb3592850a35729cb64, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 02:59:41,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure adfd1b908559471ab3375f0cd818d4fc, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 02:59:41,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 02:59:41,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:41,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:41,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ee7b1b5442d1ecb3592850a35729cb64, disabling compactions & flushes 2023-09-24 02:59:41,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing adfd1b908559471ab3375f0cd818d4fc, disabling compactions & flushes 2023-09-24 02:59:41,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:41,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:41,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. after waiting 0 ms 2023-09-24 02:59:41,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:41,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:41,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:41,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. after waiting 0 ms 2023-09-24 02:59:41,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:41,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 02:59:41,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 02:59:41,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 02:59:41,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 02:59:41,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc. 2023-09-24 02:59:41,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for adfd1b908559471ab3375f0cd818d4fc: 2023-09-24 02:59:41,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64. 2023-09-24 02:59:41,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ee7b1b5442d1ecb3592850a35729cb64: 2023-09-24 02:59:41,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:41,222 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ee7b1b5442d1ecb3592850a35729cb64, regionState=CLOSED 2023-09-24 02:59:41,222 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524381222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524381222"}]},"ts":"1695524381222"} 2023-09-24 02:59:41,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:41,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=adfd1b908559471ab3375f0cd818d4fc, regionState=CLOSED 2023-09-24 02:59:41,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695524381223"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524381223"}]},"ts":"1695524381223"} 2023-09-24 02:59:41,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-24 02:59:41,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure ee7b1b5442d1ecb3592850a35729cb64, server=jenkins-hbase20.apache.org,38603,1695524343980 in 175 msec 2023-09-24 02:59:41,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-24 02:59:41,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure adfd1b908559471ab3375f0cd818d4fc, server=jenkins-hbase20.apache.org,37585,1695524344064 in 175 msec 2023-09-24 02:59:41,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ee7b1b5442d1ecb3592850a35729cb64, UNASSIGN in 182 msec 2023-09-24 02:59:41,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-24 02:59:41,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adfd1b908559471ab3375f0cd818d4fc, UNASSIGN in 183 msec 2023-09-24 02:59:41,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524381229"}]},"ts":"1695524381229"} 2023-09-24 02:59:41,230 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-24 02:59:41,231 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-24 02:59:41,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 199 msec 2023-09-24 02:59:41,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 02:59:41,342 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-24 02:59:41,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-09-24 02:59:41,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 02:59:41,350 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 02:59:41,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-24 02:59:41,352 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 02:59:41,353 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-24 02:59:41,355 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 02:59:41,355 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 02:59:41,355 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 02:59:41,355 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 02:59:41,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 02:59:41,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 02:59:41,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 02:59:41,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 02:59:41,356 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 02:59:41,356 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 02:59:41,356 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 02:59:41,357 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:41,357 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:41,356 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:41,357 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 02:59:41,357 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:41,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-24 02:59:41,359 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:41,359 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:41,360 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/recovered.edits] 2023-09-24 02:59:41,361 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/recovered.edits] 2023-09-24 02:59:41,364 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf/ceff6e9b65d74bc4b6205e2144309912 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/cf/ceff6e9b65d74bc4b6205e2144309912 2023-09-24 02:59:41,364 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf/34ccfc9a8585434a871f6fb046118b09 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/cf/34ccfc9a8585434a871f6fb046118b09 2023-09-24 02:59:41,367 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64/recovered.edits/9.seqid 2023-09-24 02:59:41,367 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc/recovered.edits/9.seqid 2023-09-24 02:59:41,368 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/ee7b1b5442d1ecb3592850a35729cb64 2023-09-24 02:59:41,368 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemState/adfd1b908559471ab3375f0cd818d4fc 2023-09-24 02:59:41,368 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-24 02:59:41,368 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-24 02:59:41,369 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-24 02:59:41,372 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f86c2a754ae346d8bac98ca024281dc7 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f86c2a754ae346d8bac98ca024281dc7 2023-09-24 02:59:41,373 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924eea3f3988741406789f069a6439fa4be to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924eea3f3988741406789f069a6439fa4be 2023-09-24 02:59:41,373 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-24 02:59:41,375 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 02:59:41,378 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-24 02:59:41,380 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-24 02:59:41,381 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 02:59:41,381 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-24 02:59:41,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524381381"}]},"ts":"9223372036854775807"} 2023-09-24 02:59:41,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524381381"}]},"ts":"9223372036854775807"} 2023-09-24 02:59:41,383 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 02:59:41,384 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => adfd1b908559471ab3375f0cd818d4fc, NAME => 'testtb-testExportFileSystemState,,1695524365993.adfd1b908559471ab3375f0cd818d4fc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ee7b1b5442d1ecb3592850a35729cb64, NAME => 'testtb-testExportFileSystemState,1,1695524365993.ee7b1b5442d1ecb3592850a35729cb64.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 02:59:41,384 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-24 02:59:41,384 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695524381384"}]},"ts":"9223372036854775807"} 2023-09-24 02:59:41,386 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-24 02:59:41,388 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 02:59:41,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 44 msec 2023-09-24 02:59:41,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-24 02:59:41,460 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-24 02:59:41,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-24 02:59:41,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-24 02:59:41,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-09-24 02:59:41,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-24 02:59:41,501 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:53234 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1414147631_1 at /127.0.0.1:35036 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:46300 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2079 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:42715 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:35068 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=212 (was 217), ProcessCount=170 (was 172), AvailableMemoryMB=6951 (was 7015) 2023-09-24 02:59:41,501 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-24 02:59:41,522 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=212, ProcessCount=170, AvailableMemoryMB=6949 2023-09-24 02:59:41,523 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-24 02:59:41,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 02:59:41,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-24 02:59:41,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 02:59:41,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-24 02:59:41,531 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 02:59:41,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 02:59:41,533 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,534 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,534 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69 empty. 2023-09-24 02:59:41,534 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d empty. 2023-09-24 02:59:41,535 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,535 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,535 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-24 02:59:41,550 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-24 02:59:41,552 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => bfc63633a16bae6ec7e3d4a533b0850d, NAME => 'testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 02:59:41,552 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => fabbc799368c969a94cb1bb1bb73ed69, NAME => 'testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 02:59:41,568 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:41,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing bfc63633a16bae6ec7e3d4a533b0850d, disabling compactions & flushes 2023-09-24 02:59:41,569 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:41,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:41,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. after waiting 0 ms 2023-09-24 02:59:41,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:41,569 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:41,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for bfc63633a16bae6ec7e3d4a533b0850d: 2023-09-24 02:59:41,573 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:41,573 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing fabbc799368c969a94cb1bb1bb73ed69, disabling compactions & flushes 2023-09-24 02:59:41,574 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:41,574 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:41,574 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. after waiting 0 ms 2023-09-24 02:59:41,574 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:41,574 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:41,574 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for fabbc799368c969a94cb1bb1bb73ed69: 2023-09-24 02:59:41,576 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 02:59:41,577 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524381577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524381577"}]},"ts":"1695524381577"} 2023-09-24 02:59:41,577 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524381577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524381577"}]},"ts":"1695524381577"} 2023-09-24 02:59:41,580 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 02:59:41,581 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 02:59:41,581 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524381581"}]},"ts":"1695524381581"} 2023-09-24 02:59:41,583 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-24 02:59:41,585 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 02:59:41,586 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 02:59:41,586 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 02:59:41,586 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 02:59:41,586 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 02:59:41,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfc63633a16bae6ec7e3d4a533b0850d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fabbc799368c969a94cb1bb1bb73ed69, ASSIGN}] 2023-09-24 02:59:41,589 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfc63633a16bae6ec7e3d4a533b0850d, ASSIGN 2023-09-24 02:59:41,590 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fabbc799368c969a94cb1bb1bb73ed69, ASSIGN 2023-09-24 02:59:41,591 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fabbc799368c969a94cb1bb1bb73ed69, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37585,1695524344064; forceNewPlan=false, retain=false 2023-09-24 02:59:41,591 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfc63633a16bae6ec7e3d4a533b0850d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35519,1695524344025; forceNewPlan=false, retain=false 2023-09-24 02:59:41,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 02:59:41,741 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 02:59:41,747 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=fabbc799368c969a94cb1bb1bb73ed69, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:41,747 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=bfc63633a16bae6ec7e3d4a533b0850d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:41,747 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524381746"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524381746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524381746"}]},"ts":"1695524381746"} 2023-09-24 02:59:41,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524381747"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524381747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524381747"}]},"ts":"1695524381747"} 2023-09-24 02:59:41,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure fabbc799368c969a94cb1bb1bb73ed69, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 02:59:41,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure bfc63633a16bae6ec7e3d4a533b0850d, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 02:59:41,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 02:59:41,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:41,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:41,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fabbc799368c969a94cb1bb1bb73ed69, NAME => 'testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 02:59:41,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfc63633a16bae6ec7e3d4a533b0850d, NAME => 'testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 02:59:41,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. service=AccessControlService 2023-09-24 02:59:41,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. service=AccessControlService 2023-09-24 02:59:41,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:41,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 02:59:41,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 02:59:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,916 INFO [StoreOpener-bfc63633a16bae6ec7e3d4a533b0850d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,916 INFO [StoreOpener-fabbc799368c969a94cb1bb1bb73ed69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,918 DEBUG [StoreOpener-bfc63633a16bae6ec7e3d4a533b0850d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf 2023-09-24 02:59:41,918 DEBUG [StoreOpener-bfc63633a16bae6ec7e3d4a533b0850d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf 2023-09-24 02:59:41,918 DEBUG [StoreOpener-fabbc799368c969a94cb1bb1bb73ed69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf 2023-09-24 02:59:41,918 DEBUG [StoreOpener-fabbc799368c969a94cb1bb1bb73ed69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf 2023-09-24 02:59:41,918 INFO [StoreOpener-bfc63633a16bae6ec7e3d4a533b0850d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfc63633a16bae6ec7e3d4a533b0850d columnFamilyName cf 2023-09-24 02:59:41,918 INFO [StoreOpener-fabbc799368c969a94cb1bb1bb73ed69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fabbc799368c969a94cb1bb1bb73ed69 columnFamilyName cf 2023-09-24 02:59:41,919 INFO [StoreOpener-fabbc799368c969a94cb1bb1bb73ed69-1] regionserver.HStore(310): Store=fabbc799368c969a94cb1bb1bb73ed69/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:41,919 INFO [StoreOpener-bfc63633a16bae6ec7e3d4a533b0850d-1] regionserver.HStore(310): Store=bfc63633a16bae6ec7e3d4a533b0850d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 02:59:41,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 02:59:41,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 02:59:41,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:41,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 02:59:41,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fabbc799368c969a94cb1bb1bb73ed69; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65113715, jitterRate=-0.029730036854743958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:41,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bfc63633a16bae6ec7e3d4a533b0850d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64712925, jitterRate=-0.03570227324962616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 02:59:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fabbc799368c969a94cb1bb1bb73ed69: 2023-09-24 02:59:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bfc63633a16bae6ec7e3d4a533b0850d: 2023-09-24 02:59:41,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69., pid=45, masterSystemTime=1695524381903 2023-09-24 02:59:41,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d., pid=46, masterSystemTime=1695524381904 2023-09-24 02:59:41,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:41,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:41,929 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=bfc63633a16bae6ec7e3d4a533b0850d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:41,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:41,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:41,929 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524381929"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524381929"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524381929"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524381929"}]},"ts":"1695524381929"} 2023-09-24 02:59:41,929 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=fabbc799368c969a94cb1bb1bb73ed69, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:41,930 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524381929"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524381929"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524381929"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524381929"}]},"ts":"1695524381929"} 2023-09-24 02:59:41,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-24 02:59:41,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure bfc63633a16bae6ec7e3d4a533b0850d, server=jenkins-hbase20.apache.org,35519,1695524344025 in 179 msec 2023-09-24 02:59:41,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-24 02:59:41,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure fabbc799368c969a94cb1bb1bb73ed69, server=jenkins-hbase20.apache.org,37585,1695524344064 in 181 msec 2023-09-24 02:59:41,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfc63633a16bae6ec7e3d4a533b0850d, ASSIGN in 345 msec 2023-09-24 02:59:41,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-24 02:59:41,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fabbc799368c969a94cb1bb1bb73ed69, ASSIGN in 346 msec 2023-09-24 02:59:41,935 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 02:59:41,936 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524381935"}]},"ts":"1695524381935"} 2023-09-24 02:59:41,937 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-24 02:59:41,939 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 02:59:41,939 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-24 02:59:41,941 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 02:59:41,942 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:41,942 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:41,942 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:41,942 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 02:59:41,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:41,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:41,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:41,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 02:59:41,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 418 msec 2023-09-24 02:59:42,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 02:59:42,137 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-24 02:59:42,141 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-24 02:59:42,142 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:42,145 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 02:59:42,156 DEBUG [hconnection-0x182ba710-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:42,162 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:42,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 02:59:42,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524382170 (current time:1695524382170). 2023-09-24 02:59:42,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 02:59:42,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x3a139656 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:42,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7919d00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:42,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:42,184 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:42,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a139656 to 127.0.0.1:50111 2023-09-24 02:59:42,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:42,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x66bcc37a to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:42,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@403b58dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:42,201 DEBUG [hconnection-0x4bc9a447-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:42,204 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:42,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66bcc37a to 127.0.0.1:50111 2023-09-24 02:59:42,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:42,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 02:59:42,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 02:59:42,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 02:59:42,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 02:59:42,214 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 02:59:42,215 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695524982215 2023-09-24 02:59:42,215 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-24 02:59:42,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 02:59:42,217 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 02:59:42,217 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 02:59:42,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 02:59:42,220 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 02:59:42,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-09-24 02:59:42,223 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 02:59:42,223 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695524982223 2023-09-24 02:59:42,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,234 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-24 02:59:42,234 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:42,235 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-24 02:59:42,236 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-24 02:59:42,236 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,236 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,237 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,237 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,237 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,237 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,237 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,237 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,238 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,238 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 02:59:42,239 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 02:59:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,239 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 02:59:42,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,239 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 02:59:42,239 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 02:59:42,239 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:42,239 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:42,242 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,243 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 02:59:42,244 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 02:59:42,244 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 02:59:42,243 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 02:59:42,244 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 02:59:42,244 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 02:59:42,244 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 02:59:42,244 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:42,247 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 02:59:42,247 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 02:59:42,247 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 02:59:42,253 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,253 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,253 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,257 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,257 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,257 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:42,257 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,257 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:42,257 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,257 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,257 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:42,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-24 02:59:42,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c5ea7cb[Count = 1] remaining members to acquire global barrier 2023-09-24 02:59:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-24 02:59:42,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c5ea7cb[Count = 0] remaining members to acquire global barrier 2023-09-24 02:59:42,261 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-24 02:59:42,261 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,267 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,267 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,267 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 02:59:42,267 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 02:59:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 02:59:42,268 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:42,268 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,268 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:42,268 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:42,268 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. started... 2023-09-24 02:59:42,268 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. started... 2023-09-24 02:59:42,268 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:42,270 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bfc63633a16bae6ec7e3d4a533b0850d: 2023-09-24 02:59:42,270 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fabbc799368c969a94cb1bb1bb73ed69: 2023-09-24 02:59:42,270 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 02:59:42,270 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:42,270 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,270 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,271 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:42,270 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 02:59:42,272 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 02:59:42,272 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:42,272 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 02:59:42,285 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. completed. 2023-09-24 02:59:42,285 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:42,285 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:42,285 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:42,285 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,285 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 02:59:42,285 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 02:59:42,286 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,286 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 02:59:42,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,286 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. completed. 2023-09-24 02:59:42,287 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:42,286 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:42,287 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:42,288 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:42,288 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,287 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 02:59:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,288 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 02:59:42,288 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 02:59:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,289 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 02:59:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,289 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,289 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:42,289 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 02:59:42,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,35519,1695524344025': 2023-09-24 02:59:42,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-24 02:59:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,37585,1695524344064': 2023-09-24 02:59:42,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-24 02:59:42,297 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-24 02:59:42,297 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 02:59:42,297 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 02:59:42,297 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,297 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 02:59:42,312 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,312 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,313 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,313 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,315 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,316 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,316 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,317 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:42,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 02:59:42,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-24 02:59:42,318 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,320 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,322 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-24 02:59:42,321 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,322 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 02:59:42,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,322 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,322 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,322 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,322 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 02:59:42,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-24 02:59:42,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,349 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 02:59:42,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695524382215Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695524382330 (+115 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695524382330Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695524382330Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695524382334 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695524382341 (+7 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695524382349 (+8 ms) 2023-09-24 02:59:42,352 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 02:59:42,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 136 msec 2023-09-24 02:59:42,518 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:42,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 02:59:42,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 02:59:42,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35519] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 02:59:42,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37585] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 02:59:42,529 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-24 02:59:42,529 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:42,530 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 02:59:42,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 02:59:42,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524382543 (current time:1695524382543). 2023-09-24 02:59:42,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 02:59:42,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x43a2a4ed to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:42,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68666550, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:42,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:42,557 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:42,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43a2a4ed to 127.0.0.1:50111 2023-09-24 02:59:42,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:42,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x050b29cd to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 02:59:42,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5358604d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 02:59:42,573 DEBUG [hconnection-0x84fd393-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 02:59:42,576 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 02:59:42,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x050b29cd to 127.0.0.1:50111 2023-09-24 02:59:42,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 02:59:42,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 02:59:42,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 02:59:42,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 02:59:42,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 02:59:42,587 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 02:59:42,588 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695524982588 2023-09-24 02:59:42,588 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-24 02:59:42,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 02:59:42,589 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 02:59:42,589 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 02:59:42,591 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 02:59:42,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 02:59:42,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-24 02:59:42,593 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 02:59:42,594 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695524982594 2023-09-24 02:59:42,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-24 02:59:42,607 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-24 02:59:42,607 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:42,608 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-24 02:59:42,608 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-24 02:59:42,608 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,608 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,609 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,609 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,609 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,609 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,610 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,610 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,611 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,611 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,612 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 02:59:42,612 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 02:59:42,612 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 02:59:42,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 02:59:42,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 02:59:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 02:59:42,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 02:59:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 02:59:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 02:59:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:42,614 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 02:59:42,615 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 02:59:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 02:59:42,615 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 02:59:42,615 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 02:59:42,616 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 02:59:42,616 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 02:59:42,616 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 02:59:42,616 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 02:59:42,616 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 02:59:42,624 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,624 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,624 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,624 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,624 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,624 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:42,624 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,624 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,624 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:42,624 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,625 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 02:59:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-24 02:59:42,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ac999d[Count = 1] remaining members to acquire global barrier 2023-09-24 02:59:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-24 02:59:42,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ac999d[Count = 0] remaining members to acquire global barrier 2023-09-24 02:59:42,629 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-24 02:59:42,629 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,636 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,636 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,636 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,637 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 02:59:42,637 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 02:59:42,637 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 02:59:42,637 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,637 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 02:59:42,637 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 02:59:42,638 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:42,638 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:42,638 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 02:59:42,638 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:42,638 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,638 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 02:59:42,638 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. started... 2023-09-24 02:59:42,638 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 02:59:42,638 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:42,638 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. started... 2023-09-24 02:59:42,638 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bfc63633a16bae6ec7e3d4a533b0850d 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-24 02:59:42,638 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fabbc799368c969a94cb1bb1bb73ed69 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-24 02:59:42,640 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 02:59:42,640 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:42,640 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 02:59:42,659 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924ceb545db95034ba2953b02afe8dd5292 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924ceb545db95034ba2953b02afe8dd5292 2023-09-24 02:59:42,660 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092417c04f3f654a4d4fb2846fef48a5199e to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092417c04f3f654a4d4fb2846fef48a5199e 2023-09-24 02:59:42,674 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/.tmp/cf/b8e553151bc946138f22e5ac11ad2cbf 2023-09-24 02:59:42,680 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/.tmp/cf/b8e553151bc946138f22e5ac11ad2cbf as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf/b8e553151bc946138f22e5ac11ad2cbf 2023-09-24 02:59:42,682 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/.tmp/cf/73219e7ef4864aa1b8307b44fe5a1259 2023-09-24 02:59:42,686 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf/b8e553151bc946138f22e5ac11ad2cbf, entries=1, sequenceid=6, filesize=5.1 K 2023-09-24 02:59:42,687 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for bfc63633a16bae6ec7e3d4a533b0850d in 49ms, sequenceid=6, compaction requested=false 2023-09-24 02:59:42,687 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/.tmp/cf/73219e7ef4864aa1b8307b44fe5a1259 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf/73219e7ef4864aa1b8307b44fe5a1259 2023-09-24 02:59:42,687 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-24 02:59:42,688 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bfc63633a16bae6ec7e3d4a533b0850d: 2023-09-24 02:59:42,688 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 02:59:42,688 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:42,688 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf/b8e553151bc946138f22e5ac11ad2cbf] hfiles 2023-09-24 02:59:42,688 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf/b8e553151bc946138f22e5ac11ad2cbf for snapshot=snaptb0-testConsecutiveExports 2023-09-24 02:59:42,690 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:42,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 02:59:42,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-24 02:59:42,691 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 02:59:42,694 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf/73219e7ef4864aa1b8307b44fe5a1259, entries=49, sequenceid=6, filesize=13.0 K 2023-09-24 02:59:42,695 INFO [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for fabbc799368c969a94cb1bb1bb73ed69 in 57ms, sequenceid=6, compaction requested=false 2023-09-24 02:59:42,700 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fabbc799368c969a94cb1bb1bb73ed69: 2023-09-24 02:59:42,700 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 02:59:42,700 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 02:59:42,700 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf/73219e7ef4864aa1b8307b44fe5a1259] hfiles 2023-09-24 02:59:42,700 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf/73219e7ef4864aa1b8307b44fe5a1259 for snapshot=snaptb0-testConsecutiveExports 2023-09-24 02:59:42,702 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. completed. 2023-09-24 02:59:42,702 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 02:59:42,702 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:42,703 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:42,703 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,703 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 02:59:42,703 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 02:59:42,704 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 02:59:42,704 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,704 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,704 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 02:59:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,35519,1695524344025': 2023-09-24 02:59:42,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-24 02:59:42,713 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. completed. 2023-09-24 02:59:42,713 DEBUG [rs(jenkins-hbase20.apache.org,37585,1695524344064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 02:59:42,713 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 02:59:42,713 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 02:59:42,713 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,713 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 02:59:42,713 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 02:59:42,715 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 02:59:42,715 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:42,715 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,715 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 02:59:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,37585,1695524344064': 2023-09-24 02:59:42,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-24 02:59:42,720 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-24 02:59:42,720 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 02:59:42,720 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 02:59:42,720 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-24 02:59:42,720 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 02:59:42,728 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 02:59:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 02:59:42,728 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,729 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 02:59:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,729 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,730 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 02:59:42,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,731 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 02:59:42,731 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 02:59:42,732 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 02:59:42,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-24 02:59:42,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 02:59:42,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-24 02:59:42,738 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 02:59:42,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 02:59:42,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 02:59:42,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 02:59:42,740 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 02:59:42,740 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 02:59:42,740 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 02:59:42,740 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,740 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 02:59:42,740 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 02:59:42,740 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,740 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092417c04f3f654a4d4fb2846fef48a5199e, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924ceb545db95034ba2953b02afe8dd5292] mob files 2023-09-24 02:59:42,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092417c04f3f654a4d4fb2846fef48a5199e 2023-09-24 02:59:42,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924ceb545db95034ba2953b02afe8dd5292 2023-09-24 02:59:42,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-24 02:59:42,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,770 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-24 02:59:42,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,770 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695524382588Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695524382747 (+159 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695524382747Loading Region manifests for snaptb0-testConsecutiveExports at 1695524382748 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1695524382755 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695524382762 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695524382770 (+8 ms) 2023-09-24 02:59:42,773 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 02:59:42,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 184 msec 2023-09-24 02:59:42,891 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 02:59:42,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 02:59:42,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 02:59:42,896 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896 2023-09-24 02:59:42,896 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896, srcFsUri=hdfs://localhost:42749, srcDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:42,920 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:42,920 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@32d1987d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,920 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f, snapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-24 02:59:42,927 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 02:59:42,937 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:42,938 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:42,938 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:42,939 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,653 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-7231286182298241650.jar 2023-09-24 02:59:43,653 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,654 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,708 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-1346152650150056669.jar 2023-09-24 02:59:43,709 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,709 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,709 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,710 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,710 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,710 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:43,711 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 02:59:43,711 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 02:59:43,711 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 02:59:43,711 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 02:59:43,712 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 02:59:43,712 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 02:59:43,712 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 02:59:43,713 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 02:59:43,713 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 02:59:43,713 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 02:59:43,714 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:43,714 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:43,715 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:43,715 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:43,715 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:43,715 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:43,716 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:44,087 WARN [Listener at jenkins-hbase20.apache.org/38347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 02:59:44,089 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-24 02:59:44,092 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-24 02:59:45,370 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 02:59:45,370 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 02:59:45,376 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0002_000001 (auth:SIMPLE) 2023-09-24 02:59:45,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0003_000001 (auth:SIMPLE) 2023-09-24 02:59:46,799 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 02:59:48,950 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0003_000001 (auth:SIMPLE) 2023-09-24 02:59:51,165 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0003_000001 (auth:SIMPLE) 2023-09-24 02:59:53,644 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0003_000001 (auth:SIMPLE) 2023-09-24 02:59:53,655 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695524350049_0003_01_000002 is : 143 2023-09-24 02:59:55,288 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 02:59:55,288 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 02:59:55,292 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-24 02:59:55,292 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 02:59:55,293 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 02:59:55,293 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 02:59:55,295 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 02:59:55,295 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 02:59:55,295 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@41e7beec in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 02:59:55,296 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 02:59:55,296 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 02:59:55,297 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896, srcFsUri=hdfs://localhost:42749, srcDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:55,315 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 02:59:55,315 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@72061e88, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 02:59:55,315 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f, snapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-24 02:59:55,326 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 02:59:55,338 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:55,339 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:55,339 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:55,339 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,044 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-1174523490001778818.jar 2023-09-24 02:59:56,045 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,045 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,099 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-7193665125518119447.jar 2023-09-24 02:59:56,099 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,100 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,100 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,100 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,101 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,101 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 02:59:56,101 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 02:59:56,102 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 02:59:56,102 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 02:59:56,102 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 02:59:56,103 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 02:59:56,103 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 02:59:56,103 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 02:59:56,104 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 02:59:56,104 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 02:59:56,104 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 02:59:56,105 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:56,105 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:56,106 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:56,106 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:56,106 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 02:59:56,106 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:56,107 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 02:59:56,448 WARN [Listener at jenkins-hbase20.apache.org/38347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 02:59:56,451 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-24 02:59:56,453 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-24 02:59:59,839 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 02:59:59,839 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 02:59:59,841 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0003_000001 (auth:SIMPLE) 2023-09-24 03:00:00,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0004_000001 (auth:SIMPLE) 2023-09-24 03:00:04,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0004_000001 (auth:SIMPLE) 2023-09-24 03:00:06,559 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0004_000001 (auth:SIMPLE) 2023-09-24 03:00:08,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0004_000001 (auth:SIMPLE) 2023-09-24 03:00:09,639 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 03:00:09,639 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 03:00:09,641 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-24 03:00:09,642 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 03:00:09,642 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 03:00:09,642 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 03:00:09,643 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 03:00:09,643 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 03:00:09,643 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@41e7beec in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 03:00:09,643 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 03:00:09,643 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/local-export-1695524382896/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 03:00:09,653 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-24 03:00:09,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-09-24 03:00:09,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-24 03:00:09,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 03:00:09,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524409657"}]},"ts":"1695524409657"} 2023-09-24 03:00:09,658 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-24 03:00:09,659 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-24 03:00:09,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfc63633a16bae6ec7e3d4a533b0850d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fabbc799368c969a94cb1bb1bb73ed69, UNASSIGN}] 2023-09-24 03:00:09,662 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfc63633a16bae6ec7e3d4a533b0850d, UNASSIGN 2023-09-24 03:00:09,662 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fabbc799368c969a94cb1bb1bb73ed69, UNASSIGN 2023-09-24 03:00:09,664 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=bfc63633a16bae6ec7e3d4a533b0850d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:09,664 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=fabbc799368c969a94cb1bb1bb73ed69, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:09,664 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524409664"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524409664"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524409664"}]},"ts":"1695524409664"} 2023-09-24 03:00:09,664 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524409664"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524409664"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524409664"}]},"ts":"1695524409664"} 2023-09-24 03:00:09,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure bfc63633a16bae6ec7e3d4a533b0850d, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 03:00:09,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure fabbc799368c969a94cb1bb1bb73ed69, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 03:00:09,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 03:00:09,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 03:00:09,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bfc63633a16bae6ec7e3d4a533b0850d, disabling compactions & flushes 2023-09-24 03:00:09,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 03:00:09,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 03:00:09,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 03:00:09,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. after waiting 0 ms 2023-09-24 03:00:09,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 03:00:09,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fabbc799368c969a94cb1bb1bb73ed69, disabling compactions & flushes 2023-09-24 03:00:09,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 03:00:09,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 03:00:09,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. after waiting 0 ms 2023-09-24 03:00:09,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 03:00:09,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:00:09,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:00:09,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:09,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:09,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69. 2023-09-24 03:00:09,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fabbc799368c969a94cb1bb1bb73ed69: 2023-09-24 03:00:09,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d. 2023-09-24 03:00:09,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bfc63633a16bae6ec7e3d4a533b0850d: 2023-09-24 03:00:09,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 03:00:09,842 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=fabbc799368c969a94cb1bb1bb73ed69, regionState=CLOSED 2023-09-24 03:00:09,843 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524409842"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524409842"}]},"ts":"1695524409842"} 2023-09-24 03:00:09,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 03:00:09,843 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=bfc63633a16bae6ec7e3d4a533b0850d, regionState=CLOSED 2023-09-24 03:00:09,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695524409843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524409843"}]},"ts":"1695524409843"} 2023-09-24 03:00:09,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-24 03:00:09,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure fabbc799368c969a94cb1bb1bb73ed69, server=jenkins-hbase20.apache.org,37585,1695524344064 in 178 msec 2023-09-24 03:00:09,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-24 03:00:09,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure bfc63633a16bae6ec7e3d4a533b0850d, server=jenkins-hbase20.apache.org,35519,1695524344025 in 179 msec 2023-09-24 03:00:09,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fabbc799368c969a94cb1bb1bb73ed69, UNASSIGN in 187 msec 2023-09-24 03:00:09,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-24 03:00:09,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfc63633a16bae6ec7e3d4a533b0850d, UNASSIGN in 188 msec 2023-09-24 03:00:09,851 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524409851"}]},"ts":"1695524409851"} 2023-09-24 03:00:09,852 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-24 03:00:09,853 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-24 03:00:09,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 201 msec 2023-09-24 03:00:09,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 03:00:09,960 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-24 03:00:09,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-09-24 03:00:09,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 03:00:09,968 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 03:00:09,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-24 03:00:09,970 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 03:00:09,971 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-24 03:00:09,973 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 03:00:09,973 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 03:00:09,973 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 03:00:09,973 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 03:00:09,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 03:00:09,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 03:00:09,974 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 03:00:09,974 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:09,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-24 03:00:09,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-24 03:00:09,974 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 03:00:09,975 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:09,974 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:09,974 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:09,974 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 03:00:09,974 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 03:00:09,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-24 03:00:09,976 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 03:00:09,976 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 03:00:09,978 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/recovered.edits] 2023-09-24 03:00:09,978 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/recovered.edits] 2023-09-24 03:00:09,982 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf/73219e7ef4864aa1b8307b44fe5a1259 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/cf/73219e7ef4864aa1b8307b44fe5a1259 2023-09-24 03:00:09,982 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf/b8e553151bc946138f22e5ac11ad2cbf to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/cf/b8e553151bc946138f22e5ac11ad2cbf 2023-09-24 03:00:09,984 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69/recovered.edits/9.seqid 2023-09-24 03:00:09,985 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d/recovered.edits/9.seqid 2023-09-24 03:00:09,985 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/fabbc799368c969a94cb1bb1bb73ed69 2023-09-24 03:00:09,985 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testConsecutiveExports/bfc63633a16bae6ec7e3d4a533b0850d 2023-09-24 03:00:09,985 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-24 03:00:09,986 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-24 03:00:09,986 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-24 03:00:09,989 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092417c04f3f654a4d4fb2846fef48a5199e to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092417c04f3f654a4d4fb2846fef48a5199e 2023-09-24 03:00:09,990 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924ceb545db95034ba2953b02afe8dd5292 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924ceb545db95034ba2953b02afe8dd5292 2023-09-24 03:00:09,991 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-24 03:00:09,993 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 03:00:09,996 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-24 03:00:09,998 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-24 03:00:09,999 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 03:00:09,999 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-24 03:00:09,999 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524409999"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:09,999 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524409999"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:10,001 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 03:00:10,001 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bfc63633a16bae6ec7e3d4a533b0850d, NAME => 'testtb-testConsecutiveExports,,1695524381524.bfc63633a16bae6ec7e3d4a533b0850d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fabbc799368c969a94cb1bb1bb73ed69, NAME => 'testtb-testConsecutiveExports,1,1695524381524.fabbc799368c969a94cb1bb1bb73ed69.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 03:00:10,001 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-24 03:00:10,001 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695524410001"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:10,002 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-24 03:00:10,004 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 03:00:10,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-09-24 03:00:10,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-24 03:00:10,077 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-24 03:00:10,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-24 03:00:10,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-24 03:00:10,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-09-24 03:00:10,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-24 03:00:10,119 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=758 (was 763), OpenFileDescriptor=913 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 212), ProcessCount=168 (was 170), AvailableMemoryMB=6758 (was 6949) 2023-09-24 03:00:10,120 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-24 03:00:10,143 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=168, AvailableMemoryMB=6758 2023-09-24 03:00:10,143 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-24 03:00:10,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 03:00:10,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,150 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 03:00:10,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-24 03:00:10,151 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 03:00:10,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 03:00:10,154 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,154 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,154 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c empty. 2023-09-24 03:00:10,154 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc empty. 2023-09-24 03:00:10,155 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,155 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,155 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-24 03:00:10,169 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-24 03:00:10,171 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 658fbb7b6c29be8203736429860c5ebc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 03:00:10,171 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca8625a023ddac5a4669fa090cc4fc9c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 658fbb7b6c29be8203736429860c5ebc, disabling compactions & flushes 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ca8625a023ddac5a4669fa090cc4fc9c, disabling compactions & flushes 2023-09-24 03:00:10,183 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,183 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. after waiting 0 ms 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. after waiting 0 ms 2023-09-24 03:00:10,183 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,184 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,184 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 658fbb7b6c29be8203736429860c5ebc: 2023-09-24 03:00:10,184 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,184 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ca8625a023ddac5a4669fa090cc4fc9c: 2023-09-24 03:00:10,186 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 03:00:10,187 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524410187"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524410187"}]},"ts":"1695524410187"} 2023-09-24 03:00:10,187 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524410187"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524410187"}]},"ts":"1695524410187"} 2023-09-24 03:00:10,194 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 03:00:10,195 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 03:00:10,195 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524410195"}]},"ts":"1695524410195"} 2023-09-24 03:00:10,196 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-24 03:00:10,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 03:00:10,201 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 03:00:10,201 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 03:00:10,201 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 03:00:10,201 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 03:00:10,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca8625a023ddac5a4669fa090cc4fc9c, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=658fbb7b6c29be8203736429860c5ebc, ASSIGN}] 2023-09-24 03:00:10,204 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=658fbb7b6c29be8203736429860c5ebc, ASSIGN 2023-09-24 03:00:10,205 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca8625a023ddac5a4669fa090cc4fc9c, ASSIGN 2023-09-24 03:00:10,206 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=658fbb7b6c29be8203736429860c5ebc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38603,1695524343980; forceNewPlan=false, retain=false 2023-09-24 03:00:10,206 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca8625a023ddac5a4669fa090cc4fc9c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35519,1695524344025; forceNewPlan=false, retain=false 2023-09-24 03:00:10,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 03:00:10,356 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 03:00:10,363 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=658fbb7b6c29be8203736429860c5ebc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,363 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ca8625a023ddac5a4669fa090cc4fc9c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,364 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524410363"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524410363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524410363"}]},"ts":"1695524410363"} 2023-09-24 03:00:10,364 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524410363"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524410363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524410363"}]},"ts":"1695524410363"} 2023-09-24 03:00:10,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 658fbb7b6c29be8203736429860c5ebc, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:10,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure ca8625a023ddac5a4669fa090cc4fc9c, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 03:00:10,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 03:00:10,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca8625a023ddac5a4669fa090cc4fc9c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 03:00:10,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 658fbb7b6c29be8203736429860c5ebc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 03:00:10,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. service=AccessControlService 2023-09-24 03:00:10,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. service=AccessControlService 2023-09-24 03:00:10,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:10,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:10,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,533 INFO [StoreOpener-658fbb7b6c29be8203736429860c5ebc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,533 INFO [StoreOpener-ca8625a023ddac5a4669fa090cc4fc9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,535 DEBUG [StoreOpener-658fbb7b6c29be8203736429860c5ebc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf 2023-09-24 03:00:10,535 DEBUG [StoreOpener-ca8625a023ddac5a4669fa090cc4fc9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf 2023-09-24 03:00:10,535 DEBUG [StoreOpener-ca8625a023ddac5a4669fa090cc4fc9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf 2023-09-24 03:00:10,535 DEBUG [StoreOpener-658fbb7b6c29be8203736429860c5ebc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf 2023-09-24 03:00:10,536 INFO [StoreOpener-ca8625a023ddac5a4669fa090cc4fc9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca8625a023ddac5a4669fa090cc4fc9c columnFamilyName cf 2023-09-24 03:00:10,536 INFO [StoreOpener-658fbb7b6c29be8203736429860c5ebc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 658fbb7b6c29be8203736429860c5ebc columnFamilyName cf 2023-09-24 03:00:10,538 INFO [StoreOpener-ca8625a023ddac5a4669fa090cc4fc9c-1] regionserver.HStore(310): Store=ca8625a023ddac5a4669fa090cc4fc9c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:10,538 INFO [StoreOpener-658fbb7b6c29be8203736429860c5ebc-1] regionserver.HStore(310): Store=658fbb7b6c29be8203736429860c5ebc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:10,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:10,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 03:00:10,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 03:00:10,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ca8625a023ddac5a4669fa090cc4fc9c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71908621, jitterRate=0.07152195274829865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:10,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 658fbb7b6c29be8203736429860c5ebc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69973087, jitterRate=0.042680248618125916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ca8625a023ddac5a4669fa090cc4fc9c: 2023-09-24 03:00:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 658fbb7b6c29be8203736429860c5ebc: 2023-09-24 03:00:10,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c., pid=61, masterSystemTime=1695524410520 2023-09-24 03:00:10,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc., pid=60, masterSystemTime=1695524410520 2023-09-24 03:00:10,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,558 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ca8625a023ddac5a4669fa090cc4fc9c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,559 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524410558"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524410558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524410558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524410558"}]},"ts":"1695524410558"} 2023-09-24 03:00:10,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=658fbb7b6c29be8203736429860c5ebc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,559 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524410559"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524410559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524410559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524410559"}]},"ts":"1695524410559"} 2023-09-24 03:00:10,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-24 03:00:10,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure ca8625a023ddac5a4669fa090cc4fc9c, server=jenkins-hbase20.apache.org,35519,1695524344025 in 191 msec 2023-09-24 03:00:10,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-24 03:00:10,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 658fbb7b6c29be8203736429860c5ebc, server=jenkins-hbase20.apache.org,38603,1695524343980 in 193 msec 2023-09-24 03:00:10,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca8625a023ddac5a4669fa090cc4fc9c, ASSIGN in 361 msec 2023-09-24 03:00:10,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-24 03:00:10,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=658fbb7b6c29be8203736429860c5ebc, ASSIGN in 361 msec 2023-09-24 03:00:10,564 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 03:00:10,564 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524410564"}]},"ts":"1695524410564"} 2023-09-24 03:00:10,565 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-24 03:00:10,567 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 03:00:10,567 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-24 03:00:10,569 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 03:00:10,570 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:10,570 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:10,570 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:10,570 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:10,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:10,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:10,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:10,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:10,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 426 msec 2023-09-24 03:00:10,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 03:00:10,758 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-24 03:00:10,760 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,761 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,763 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 03:00:10,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 03:00:10,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524410778 (current time:1695524410778). 2023-09-24 03:00:10,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 03:00:10,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x5ca4b35b to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:10,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38662841, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:10,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:10,788 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:10,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ca4b35b to 127.0.0.1:50111 2023-09-24 03:00:10,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:10,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x1ef87f03 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:10,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67bf39ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:10,805 DEBUG [hconnection-0x6e12217a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:10,806 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:10,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ef87f03 to 127.0.0.1:50111 2023-09-24 03:00:10,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:10,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 03:00:10,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 03:00:10,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 03:00:10,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 03:00:10,819 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 03:00:10,820 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695525010820 2023-09-24 03:00:10,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 03:00:10,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,822 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 03:00:10,822 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 03:00:10,824 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 03:00:10,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 03:00:10,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-24 03:00:10,826 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 03:00:10,827 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695525010827 2023-09-24 03:00:10,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,835 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-24 03:00:10,835 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:10,836 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-24 03:00:10,836 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-24 03:00:10,836 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,836 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:10,837 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:10,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:10,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:10,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:10,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:10,838 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:10,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,838 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,838 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,838 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 03:00:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 03:00:10,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 03:00:10,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 03:00:10,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,839 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 03:00:10,839 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 03:00:10,839 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:10,839 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 03:00:10,840 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 03:00:10,840 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 03:00:10,840 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 03:00:10,840 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:10,839 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:10,842 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 03:00:10,843 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 03:00:10,842 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 03:00:10,843 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 03:00:10,843 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 03:00:10,843 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 03:00:10,847 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,847 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:10,848 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,848 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,848 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,848 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:10,848 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,848 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:10,848 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:10,848 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,848 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:10,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 03:00:10,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13030f2a[Count = 1] remaining members to acquire global barrier 2023-09-24 03:00:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:10,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 03:00:10,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13030f2a[Count = 0] remaining members to acquire global barrier 2023-09-24 03:00:10,852 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-24 03:00:10,852 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,853 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,853 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,853 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,853 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,853 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 03:00:10,853 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 03:00:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 03:00:10,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 03:00:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 03:00:10,854 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,854 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 03:00:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:10,854 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:10,854 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,854 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. started... 2023-09-24 03:00:10,854 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. started... 2023-09-24 03:00:10,855 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca8625a023ddac5a4669fa090cc4fc9c: 2023-09-24 03:00:10,855 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 658fbb7b6c29be8203736429860c5ebc: 2023-09-24 03:00:10,855 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,856 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,856 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:10,856 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:10,856 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 03:00:10,856 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 03:00:10,856 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 03:00:10,856 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:10,856 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 03:00:10,864 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. completed. 2023-09-24 03:00:10,865 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:10,865 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. completed. 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,865 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 03:00:10,865 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 03:00:10,866 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 03:00:10,866 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:10,866 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,866 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 03:00:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:10,868 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 03:00:10,868 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:10,868 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:10,868 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 03:00:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 03:00:10,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-24 03:00:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:10,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,35519,1695524344025': 2023-09-24 03:00:10,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-24 03:00:10,877 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-24 03:00:10,877 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 03:00:10,877 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 03:00:10,877 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,877 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 03:00:10,878 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,878 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,878 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:10,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,878 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,878 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,879 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:10,879 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,879 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:10,880 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:10,880 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,881 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,881 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:10,882 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,894 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,894 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:10,894 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:10,894 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:10,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:10,894 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:10,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,894 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:10,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:10,894 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:10,894 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:10,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:10,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:10,894 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:10,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:10,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,896 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 03:00:10,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:10,896 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:10,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:10,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:10,896 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:10,896 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:10,896 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,896 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:10,896 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:10,896 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,897 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 03:00:10,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,922 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:10,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 03:00:10,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-24 03:00:10,923 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 03:00:10,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-24 03:00:10,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,932 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:10,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695524410820Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695524410904 (+84 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695524410904Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695524410904Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695524410914 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695524410923 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695524410931 (+8 ms) 2023-09-24 03:00:10,934 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 03:00:10,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 112 msec 2023-09-24 03:00:11,124 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:11,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 03:00:11,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 03:00:11,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35519] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 03:00:11,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38603] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 03:00:11,140 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,140 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:11,141 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 03:00:11,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 03:00:11,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524411151 (current time:1695524411151). 2023-09-24 03:00:11,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 03:00:11,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x36206ce8 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:11,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12300ecd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:11,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:11,163 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:11,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36206ce8 to 127.0.0.1:50111 2023-09-24 03:00:11,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:11,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x7d2b5bf7 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:11,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48d93f96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:11,176 DEBUG [hconnection-0x5a0d0626-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:11,180 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:11,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d2b5bf7 to 127.0.0.1:50111 2023-09-24 03:00:11,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:11,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 03:00:11,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 03:00:11,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 03:00:11,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 03:00:11,197 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 03:00:11,197 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695525011197 2023-09-24 03:00:11,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 03:00:11,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,199 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 03:00:11,199 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 03:00:11,201 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 03:00:11,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 03:00:11,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-24 03:00:11,204 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 03:00:11,204 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695525011204 2023-09-24 03:00:11,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,214 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-24 03:00:11,214 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:11,215 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-24 03:00:11,216 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-24 03:00:11,216 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,216 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,217 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:11,217 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:11,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:11,217 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:11,217 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:11,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:11,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:11,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:11,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:11,218 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,218 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,219 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,219 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 03:00:11,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,223 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 03:00:11,223 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 03:00:11,223 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:11,223 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:11,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,225 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 03:00:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 03:00:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 03:00:11,227 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 03:00:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 03:00:11,227 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 03:00:11,227 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 03:00:11,227 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 03:00:11,227 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 03:00:11,227 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,231 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,231 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,231 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cd74dcd[Count = 1] remaining members to acquire global barrier 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:11,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 03:00:11,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cd74dcd[Count = 0] remaining members to acquire global barrier 2023-09-24 03:00:11,234 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-24 03:00:11,234 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 03:00:11,235 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:11,235 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:11,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,235 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. started... 2023-09-24 03:00:11,235 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 03:00:11,235 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,236 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 03:00:11,235 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:11,235 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 03:00:11,236 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ca8625a023ddac5a4669fa090cc4fc9c 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-24 03:00:11,236 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 03:00:11,236 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:11,236 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:11,236 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 03:00:11,236 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:11,236 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. started... 2023-09-24 03:00:11,236 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 658fbb7b6c29be8203736429860c5ebc 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-24 03:00:11,237 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 03:00:11,237 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:11,237 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 03:00:11,261 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924481c1f3d82f2417fb44f9e79685de817 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924481c1f3d82f2417fb44f9e79685de817 2023-09-24 03:00:11,261 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309248ae311ccc28544209d8e9a694580ce52 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309248ae311ccc28544209d8e9a694580ce52 2023-09-24 03:00:11,267 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/.tmp/cf/75fc8a9bcc5847e4a6f1161db9c8ea9d 2023-09-24 03:00:11,267 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/.tmp/cf/cd3e84b630f64bef936db2abaf6b0fb6 2023-09-24 03:00:11,272 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/.tmp/cf/cd3e84b630f64bef936db2abaf6b0fb6 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf/cd3e84b630f64bef936db2abaf6b0fb6 2023-09-24 03:00:11,272 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/.tmp/cf/75fc8a9bcc5847e4a6f1161db9c8ea9d as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf/75fc8a9bcc5847e4a6f1161db9c8ea9d 2023-09-24 03:00:11,277 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf/75fc8a9bcc5847e4a6f1161db9c8ea9d, entries=4, sequenceid=6, filesize=5.6 K 2023-09-24 03:00:11,277 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf/cd3e84b630f64bef936db2abaf6b0fb6, entries=46, sequenceid=6, filesize=13.3 K 2023-09-24 03:00:11,278 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 658fbb7b6c29be8203736429860c5ebc in 42ms, sequenceid=6, compaction requested=false 2023-09-24 03:00:11,278 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for ca8625a023ddac5a4669fa090cc4fc9c in 42ms, sequenceid=6, compaction requested=false 2023-09-24 03:00:11,278 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-24 03:00:11,278 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-24 03:00:11,281 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca8625a023ddac5a4669fa090cc4fc9c: 2023-09-24 03:00:11,281 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 658fbb7b6c29be8203736429860c5ebc: 2023-09-24 03:00:11,281 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,281 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,281 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:11,281 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:11,281 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf/cd3e84b630f64bef936db2abaf6b0fb6] hfiles 2023-09-24 03:00:11,282 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf/75fc8a9bcc5847e4a6f1161db9c8ea9d] hfiles 2023-09-24 03:00:11,282 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf/cd3e84b630f64bef936db2abaf6b0fb6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,282 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf/75fc8a9bcc5847e4a6f1161db9c8ea9d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,291 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. completed. 2023-09-24 03:00:11,291 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:11,291 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. completed. 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:11,291 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 03:00:11,291 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 03:00:11,292 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 03:00:11,292 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 03:00:11,292 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,292 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:11,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,292 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 03:00:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:11,294 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 03:00:11,294 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,294 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:11,294 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 03:00:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:11,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:11,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 03:00:11,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-24 03:00:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:11,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:11,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:11,301 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 03:00:11,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-24 03:00:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,302 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 03:00:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,35519,1695524344025': 2023-09-24 03:00:11,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-24 03:00:11,303 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-24 03:00:11,304 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 03:00:11,304 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 03:00:11,304 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,304 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 03:00:11,307 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:11,307 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:11,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:11,307 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:11,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:11,308 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:11,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,308 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:11,310 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,311 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,311 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:11,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:11,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:11,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:11,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:11,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:11,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:11,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:11,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:11,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:11,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,320 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:11,320 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:11,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 03:00:11,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:11,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:11,323 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:11,323 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:11,323 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,324 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,324 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,325 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,325 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924481c1f3d82f2417fb44f9e79685de817, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309248ae311ccc28544209d8e9a694580ce52] mob files 2023-09-24 03:00:11,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924481c1f3d82f2417fb44f9e79685de817 2023-09-24 03:00:11,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309248ae311ccc28544209d8e9a694580ce52 2023-09-24 03:00:11,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-24 03:00:11,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,356 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:11,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695524411198Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695524411333 (+135 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695524411333Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695524411333Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695524411337 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695524411346 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695524411356 (+10 ms) 2023-09-24 03:00:11,359 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 03:00:11,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 160 msec 2023-09-24 03:00:11,502 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:11,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 03:00:11,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 03:00:11,534 DEBUG [Listener at jenkins-hbase20.apache.org/38347] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 03:00:11,540 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 03:00:11,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35519] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 03:00:11,542 DEBUG [Listener at jenkins-hbase20.apache.org/38347] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 03:00:11,547 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 03:00:11,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37585] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 03:00:11,548 DEBUG [Listener at jenkins-hbase20.apache.org/38347] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 03:00:11,553 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 03:00:11,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38603] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 03:00:11,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-24 03:00:11,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:11,558 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 03:00:11,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-24 03:00:11,559 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 03:00:11,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 03:00:11,561 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,561 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,562 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b empty. 2023-09-24 03:00:11,562 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183 empty. 2023-09-24 03:00:11,562 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,562 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,562 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-24 03:00:11,573 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-24 03:00:11,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e35053a973e15d7766d2293b59034a4b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 03:00:11,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 728157cb633d8ac1b2d034494f1b5183, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 728157cb633d8ac1b2d034494f1b5183, disabling compactions & flushes 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e35053a973e15d7766d2293b59034a4b, disabling compactions & flushes 2023-09-24 03:00:11,585 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:11,585 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. after waiting 0 ms 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. after waiting 0 ms 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:11,585 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:11,585 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 728157cb633d8ac1b2d034494f1b5183: 2023-09-24 03:00:11,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e35053a973e15d7766d2293b59034a4b: 2023-09-24 03:00:11,587 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 03:00:11,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524411588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524411588"}]},"ts":"1695524411588"} 2023-09-24 03:00:11,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524411588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524411588"}]},"ts":"1695524411588"} 2023-09-24 03:00:11,590 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 03:00:11,591 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 03:00:11,591 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524411591"}]},"ts":"1695524411591"} 2023-09-24 03:00:11,592 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-24 03:00:11,594 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 03:00:11,596 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 03:00:11,596 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 03:00:11,596 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 03:00:11,596 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 03:00:11,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e35053a973e15d7766d2293b59034a4b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728157cb633d8ac1b2d034494f1b5183, ASSIGN}] 2023-09-24 03:00:11,598 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e35053a973e15d7766d2293b59034a4b, ASSIGN 2023-09-24 03:00:11,598 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728157cb633d8ac1b2d034494f1b5183, ASSIGN 2023-09-24 03:00:11,599 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e35053a973e15d7766d2293b59034a4b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38603,1695524343980; forceNewPlan=false, retain=false 2023-09-24 03:00:11,599 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728157cb633d8ac1b2d034494f1b5183, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37585,1695524344064; forceNewPlan=false, retain=false 2023-09-24 03:00:11,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 03:00:11,750 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 03:00:11,757 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e35053a973e15d7766d2293b59034a4b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,757 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=728157cb633d8ac1b2d034494f1b5183, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,757 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524411757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524411757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524411757"}]},"ts":"1695524411757"} 2023-09-24 03:00:11,758 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524411757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524411757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524411757"}]},"ts":"1695524411757"} 2023-09-24 03:00:11,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure e35053a973e15d7766d2293b59034a4b, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:11,763 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 728157cb633d8ac1b2d034494f1b5183, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 03:00:11,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 03:00:11,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:11,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:11,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e35053a973e15d7766d2293b59034a4b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.', STARTKEY => '', ENDKEY => '2'} 2023-09-24 03:00:11,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 728157cb633d8ac1b2d034494f1b5183, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.', STARTKEY => '2', ENDKEY => ''} 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. service=AccessControlService 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. service=AccessControlService 2023-09-24 03:00:11,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:11,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,930 INFO [StoreOpener-e35053a973e15d7766d2293b59034a4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,930 INFO [StoreOpener-728157cb633d8ac1b2d034494f1b5183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,936 DEBUG [StoreOpener-728157cb633d8ac1b2d034494f1b5183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf 2023-09-24 03:00:11,936 DEBUG [StoreOpener-e35053a973e15d7766d2293b59034a4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf 2023-09-24 03:00:11,936 DEBUG [StoreOpener-e35053a973e15d7766d2293b59034a4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf 2023-09-24 03:00:11,936 DEBUG [StoreOpener-728157cb633d8ac1b2d034494f1b5183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf 2023-09-24 03:00:11,937 INFO [StoreOpener-e35053a973e15d7766d2293b59034a4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e35053a973e15d7766d2293b59034a4b columnFamilyName cf 2023-09-24 03:00:11,937 INFO [StoreOpener-728157cb633d8ac1b2d034494f1b5183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 728157cb633d8ac1b2d034494f1b5183 columnFamilyName cf 2023-09-24 03:00:11,937 INFO [StoreOpener-e35053a973e15d7766d2293b59034a4b-1] regionserver.HStore(310): Store=e35053a973e15d7766d2293b59034a4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:11,937 INFO [StoreOpener-728157cb633d8ac1b2d034494f1b5183-1] regionserver.HStore(310): Store=728157cb633d8ac1b2d034494f1b5183/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:11,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:11,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:11,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 03:00:11,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 03:00:11,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 728157cb633d8ac1b2d034494f1b5183; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68008848, jitterRate=0.013410806655883789}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:11,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e35053a973e15d7766d2293b59034a4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68586396, jitterRate=0.022016942501068115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:11,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 728157cb633d8ac1b2d034494f1b5183: 2023-09-24 03:00:11,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e35053a973e15d7766d2293b59034a4b: 2023-09-24 03:00:11,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b., pid=69, masterSystemTime=1695524411914 2023-09-24 03:00:11,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183., pid=70, masterSystemTime=1695524411914 2023-09-24 03:00:11,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:11,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:11,945 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e35053a973e15d7766d2293b59034a4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:11,945 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524411945"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524411945"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524411945"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524411945"}]},"ts":"1695524411945"} 2023-09-24 03:00:11,945 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=728157cb633d8ac1b2d034494f1b5183, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:11,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:11,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:11,945 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524411945"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524411945"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524411945"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524411945"}]},"ts":"1695524411945"} 2023-09-24 03:00:11,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-24 03:00:11,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure e35053a973e15d7766d2293b59034a4b, server=jenkins-hbase20.apache.org,38603,1695524343980 in 185 msec 2023-09-24 03:00:11,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-24 03:00:11,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 728157cb633d8ac1b2d034494f1b5183, server=jenkins-hbase20.apache.org,37585,1695524344064 in 184 msec 2023-09-24 03:00:11,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e35053a973e15d7766d2293b59034a4b, ASSIGN in 352 msec 2023-09-24 03:00:11,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-24 03:00:11,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728157cb633d8ac1b2d034494f1b5183, ASSIGN in 353 msec 2023-09-24 03:00:11,951 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 03:00:11,951 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524411951"}]},"ts":"1695524411951"} 2023-09-24 03:00:11,953 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-24 03:00:11,954 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 03:00:11,955 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-24 03:00:11,956 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-24 03:00:11,957 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:11,957 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:11,957 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:11,957 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:11,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:11,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:11,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:11,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:11,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:11,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:11,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:11,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:11,959 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 403 msec 2023-09-24 03:00:12,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 03:00:12,166 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-24 03:00:12,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions e35053a973e15d7766d2293b59034a4b, 728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:12,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e35053a973e15d7766d2293b59034a4b, 728157cb633d8ac1b2d034494f1b5183], force=true 2023-09-24 03:00:12,200 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e35053a973e15d7766d2293b59034a4b, 728157cb633d8ac1b2d034494f1b5183], force=true 2023-09-24 03:00:12,200 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e35053a973e15d7766d2293b59034a4b, 728157cb633d8ac1b2d034494f1b5183], force=true 2023-09-24 03:00:12,200 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e35053a973e15d7766d2293b59034a4b, 728157cb633d8ac1b2d034494f1b5183], force=true 2023-09-24 03:00:12,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 03:00:12,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e35053a973e15d7766d2293b59034a4b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728157cb633d8ac1b2d034494f1b5183, UNASSIGN}] 2023-09-24 03:00:12,224 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728157cb633d8ac1b2d034494f1b5183, UNASSIGN 2023-09-24 03:00:12,224 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e35053a973e15d7766d2293b59034a4b, UNASSIGN 2023-09-24 03:00:12,224 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e35053a973e15d7766d2293b59034a4b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:12,224 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=728157cb633d8ac1b2d034494f1b5183, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:12,225 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524412224"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524412224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524412224"}]},"ts":"1695524412224"} 2023-09-24 03:00:12,225 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524412224"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524412224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524412224"}]},"ts":"1695524412224"} 2023-09-24 03:00:12,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure e35053a973e15d7766d2293b59034a4b, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:12,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 728157cb633d8ac1b2d034494f1b5183, server=jenkins-hbase20.apache.org,37585,1695524344064}] 2023-09-24 03:00:12,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 03:00:12,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:12,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:12,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 728157cb633d8ac1b2d034494f1b5183, disabling compactions & flushes 2023-09-24 03:00:12,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e35053a973e15d7766d2293b59034a4b, disabling compactions & flushes 2023-09-24 03:00:12,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:12,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:12,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. after waiting 0 ms 2023-09-24 03:00:12,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:12,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:12,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e35053a973e15d7766d2293b59034a4b 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-24 03:00:12,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:12,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. after waiting 0 ms 2023-09-24 03:00:12,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:12,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 728157cb633d8ac1b2d034494f1b5183 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-24 03:00:12,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/.tmp/cf/81c4f604004842429cd5f1b63d701675 2023-09-24 03:00:12,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/.tmp/cf/acac091a42624f34b80b5edc471abdd0 2023-09-24 03:00:12,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/.tmp/cf/acac091a42624f34b80b5edc471abdd0 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf/acac091a42624f34b80b5edc471abdd0 2023-09-24 03:00:12,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/.tmp/cf/81c4f604004842429cd5f1b63d701675 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf/81c4f604004842429cd5f1b63d701675 2023-09-24 03:00:12,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf/acac091a42624f34b80b5edc471abdd0, entries=1, sequenceid=5, filesize=4.7 K 2023-09-24 03:00:12,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf/81c4f604004842429cd5f1b63d701675, entries=1, sequenceid=5, filesize=4.7 K 2023-09-24 03:00:12,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 728157cb633d8ac1b2d034494f1b5183 in 30ms, sequenceid=5, compaction requested=false 2023-09-24 03:00:12,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-24 03:00:12,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e35053a973e15d7766d2293b59034a4b in 30ms, sequenceid=5, compaction requested=false 2023-09-24 03:00:12,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-24 03:00:12,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-24 03:00:12,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-24 03:00:12,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:12,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:12,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b. 2023-09-24 03:00:12,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e35053a973e15d7766d2293b59034a4b: 2023-09-24 03:00:12,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183. 2023-09-24 03:00:12,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 728157cb633d8ac1b2d034494f1b5183: 2023-09-24 03:00:12,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:12,424 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e35053a973e15d7766d2293b59034a4b, regionState=CLOSED 2023-09-24 03:00:12,424 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524412423"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524412423"}]},"ts":"1695524412423"} 2023-09-24 03:00:12,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:12,424 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=728157cb633d8ac1b2d034494f1b5183, regionState=CLOSED 2023-09-24 03:00:12,424 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695524412424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524412424"}]},"ts":"1695524412424"} 2023-09-24 03:00:12,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-24 03:00:12,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure e35053a973e15d7766d2293b59034a4b, server=jenkins-hbase20.apache.org,38603,1695524343980 in 199 msec 2023-09-24 03:00:12,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-24 03:00:12,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 728157cb633d8ac1b2d034494f1b5183, server=jenkins-hbase20.apache.org,37585,1695524344064 in 200 msec 2023-09-24 03:00:12,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e35053a973e15d7766d2293b59034a4b, UNASSIGN in 209 msec 2023-09-24 03:00:12,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-24 03:00:12,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728157cb633d8ac1b2d034494f1b5183, UNASSIGN in 206 msec 2023-09-24 03:00:12,469 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-24 03:00:12,471 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411555.e35053a973e15d7766d2293b59034a4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:12,471 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695524411555.728157cb633d8ac1b2d034494f1b5183.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:12,471 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:12,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 03:00:12,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=089de905be6ab08bbde884cc9dffe392, ASSIGN}] 2023-09-24 03:00:12,515 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=089de905be6ab08bbde884cc9dffe392, ASSIGN 2023-09-24 03:00:12,516 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=089de905be6ab08bbde884cc9dffe392, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,38603,1695524343980; forceNewPlan=false, retain=false 2023-09-24 03:00:12,666 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 03:00:12,668 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=089de905be6ab08bbde884cc9dffe392, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:12,669 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695524412668"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524412668"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524412668"}]},"ts":"1695524412668"} 2023-09-24 03:00:12,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 089de905be6ab08bbde884cc9dffe392, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:12,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 03:00:12,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:12,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 089de905be6ab08bbde884cc9dffe392, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.', STARTKEY => '', ENDKEY => ''} 2023-09-24 03:00:12,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. service=AccessControlService 2023-09-24 03:00:12,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:12,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:12,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:12,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:12,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:12,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/.regioninfo 2023-09-24 03:00:12,849 INFO [StoreOpener-089de905be6ab08bbde884cc9dffe392-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:12,850 DEBUG [StoreOpener-089de905be6ab08bbde884cc9dffe392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf 2023-09-24 03:00:12,850 DEBUG [StoreOpener-089de905be6ab08bbde884cc9dffe392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf 2023-09-24 03:00:12,850 INFO [StoreOpener-089de905be6ab08bbde884cc9dffe392-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 089de905be6ab08bbde884cc9dffe392 columnFamilyName cf 2023-09-24 03:00:12,876 DEBUG [StoreOpener-089de905be6ab08bbde884cc9dffe392-1] regionserver.HStore(539): loaded hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/81c4f604004842429cd5f1b63d701675.e35053a973e15d7766d2293b59034a4b->hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf/81c4f604004842429cd5f1b63d701675-top 2023-09-24 03:00:12,881 DEBUG [StoreOpener-089de905be6ab08bbde884cc9dffe392-1] regionserver.HStore(539): loaded hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/acac091a42624f34b80b5edc471abdd0.728157cb633d8ac1b2d034494f1b5183->hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf/acac091a42624f34b80b5edc471abdd0-top 2023-09-24 03:00:12,882 INFO [StoreOpener-089de905be6ab08bbde884cc9dffe392-1] regionserver.HStore(310): Store=089de905be6ab08bbde884cc9dffe392/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:12,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:12,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:12,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:12,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 089de905be6ab08bbde884cc9dffe392; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61351168, jitterRate=-0.08579635620117188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:12,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 089de905be6ab08bbde884cc9dffe392: 2023-09-24 03:00:12,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392., pid=77, masterSystemTime=1695524412824 2023-09-24 03:00:12,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.,because compaction is disabled. 2023-09-24 03:00:12,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:12,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:12,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=089de905be6ab08bbde884cc9dffe392, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:12,890 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695524412890"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524412890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524412890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524412890"}]},"ts":"1695524412890"} 2023-09-24 03:00:12,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-24 03:00:12,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 089de905be6ab08bbde884cc9dffe392, server=jenkins-hbase20.apache.org,38603,1695524343980 in 221 msec 2023-09-24 03:00:12,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-24 03:00:12,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=089de905be6ab08bbde884cc9dffe392, ASSIGN in 380 msec 2023-09-24 03:00:12,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e35053a973e15d7766d2293b59034a4b, 728157cb633d8ac1b2d034494f1b5183], force=true in 703 msec 2023-09-24 03:00:13,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 03:00:13,312 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-24 03:00:13,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 03:00:13,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524413315 (current time:1695524413315). 2023-09-24 03:00:13,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 03:00:13,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x6a1ab61c to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:13,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56bdb240, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:13,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:13,330 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:13,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a1ab61c to 127.0.0.1:50111 2023-09-24 03:00:13,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:13,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x5845a1cf to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:13,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6750568d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:13,352 DEBUG [hconnection-0x5cc4d795-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:13,353 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:13,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5845a1cf to 127.0.0.1:50111 2023-09-24 03:00:13,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:13,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-24 03:00:13,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 03:00:13,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 03:00:13,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 03:00:13,369 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 03:00:13,369 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695525013369 2023-09-24 03:00:13,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 03:00:13,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,373 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 03:00:13,373 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 03:00:13,374 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 03:00:13,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 03:00:13,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-09-24 03:00:13,377 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 03:00:13,377 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695525013377 2023-09-24 03:00:13,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,385 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-24 03:00:13,385 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:13,386 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-24 03:00:13,386 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-24 03:00:13,387 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,387 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,388 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:13,388 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:13,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:13,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:13,388 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:13,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:13,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,388 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,388 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 03:00:13,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,389 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 03:00:13,389 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:13,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,391 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 03:00:13,391 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 03:00:13,391 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:13,391 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 03:00:13,391 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 03:00:13,391 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:13,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:13,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:13,392 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 03:00:13,392 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 03:00:13,392 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 03:00:13,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,397 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,398 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 03:00:13,398 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:13,400 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 03:00:13,400 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 03:00:13,400 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 03:00:13,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,400 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:13,401 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,401 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:13,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-24 03:00:13,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eed963[Count = 0] remaining members to acquire global barrier 2023-09-24 03:00:13,401 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-24 03:00:13,401 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,401 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 03:00:13,402 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,402 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 03:00:13,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:13,402 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 03:00:13,402 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. started... 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 03:00:13,402 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 03:00:13,404 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 089de905be6ab08bbde884cc9dffe392: 2023-09-24 03:00:13,404 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,404 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:13,404 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/81c4f604004842429cd5f1b63d701675.e35053a973e15d7766d2293b59034a4b->hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf/81c4f604004842429cd5f1b63d701675-top, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/acac091a42624f34b80b5edc471abdd0.728157cb633d8ac1b2d034494f1b5183->hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf/acac091a42624f34b80b5edc471abdd0-top] hfiles 2023-09-24 03:00:13,404 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/81c4f604004842429cd5f1b63d701675.e35053a973e15d7766d2293b59034a4b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,404 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 03:00:13,404 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:13,404 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 03:00:13,406 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 03:00:13,406 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:13,406 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 03:00:13,409 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/acac091a42624f34b80b5edc471abdd0.728157cb633d8ac1b2d034494f1b5183 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,416 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. completed. 2023-09-24 03:00:13,416 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:13,417 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:13,417 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:13,417 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,417 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 03:00:13,417 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 03:00:13,420 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 03:00:13,420 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,420 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:13,420 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 03:00:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 03:00:13,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-24 03:00:13,423 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-24 03:00:13,423 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 03:00:13,423 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 03:00:13,423 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,423 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 03:00:13,431 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,431 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:13,431 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,431 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:13,431 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:13,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,431 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,432 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,432 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:13,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:13,432 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:13,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:13,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:13,433 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:13,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:13,435 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:13,436 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,436 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:13,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:13,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:13,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:13,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:13,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:13,440 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:13,440 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:13,441 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,441 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,441 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:13,441 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,441 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:13,441 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:13,441 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,441 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:13,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:13,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,461 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-24 03:00:13,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,462 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695524413369Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695524413440 (+71 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695524413440Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695524413443 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695524413454 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695524413461 (+7 ms) 2023-09-24 03:00:13,464 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 03:00:13,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 91 msec 2023-09-24 03:00:13,475 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:13,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-24 03:00:13,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 03:00:13,476 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476 2023-09-24 03:00:13,476 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42749, tgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476, rawTgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476, srcFsUri=hdfs://localhost:42749, srcDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 03:00:13,494 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 03:00:13,494 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1143812569_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,494 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f, snapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-24 03:00:13,503 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:13,517 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:13,517 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:13,518 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:13,518 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,224 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-3448632128954911427.jar 2023-09-24 03:00:14,225 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,225 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,278 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-455964006754674856.jar 2023-09-24 03:00:14,278 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,279 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,279 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,279 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,280 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,280 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:14,280 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 03:00:14,281 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 03:00:14,281 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 03:00:14,281 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 03:00:14,281 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 03:00:14,282 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 03:00:14,282 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 03:00:14,282 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 03:00:14,283 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 03:00:14,283 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 03:00:14,283 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:14,284 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:14,284 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:14,284 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:14,285 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:14,285 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:14,285 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:14,623 WARN [Listener at jenkins-hbase20.apache.org/38347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 03:00:14,625 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-24 03:00:14,627 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-24 03:00:14,689 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 03:00:14,689 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 03:00:14,694 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0004_000001 (auth:SIMPLE) 2023-09-24 03:00:14,851 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0005_000001 (auth:SIMPLE) 2023-09-24 03:00:15,420 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 03:00:18,189 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0005_000001 (auth:SIMPLE) 2023-09-24 03:00:20,383 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0005_000001 (auth:SIMPLE) 2023-09-24 03:00:22,986 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0005_000001 (auth:SIMPLE) 2023-09-24 03:00:22,997 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695524350049_0005_01_000002 is : 143 2023-09-24 03:00:24,797 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 03:00:24,800 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 03:00:24,807 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:24,808 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 03:00:24,808 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 03:00:24,808 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:24,809 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-24 03:00:24,809 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-24 03:00:24,809 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:24,809 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-24 03:00:24,809 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524413476/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-24 03:00:24,816 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:24,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:24,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:24,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 03:00:24,820 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524424820"}]},"ts":"1695524424820"} 2023-09-24 03:00:24,821 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-24 03:00:24,822 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-24 03:00:24,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=089de905be6ab08bbde884cc9dffe392, UNASSIGN}] 2023-09-24 03:00:24,824 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=089de905be6ab08bbde884cc9dffe392, UNASSIGN 2023-09-24 03:00:24,824 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=089de905be6ab08bbde884cc9dffe392, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:24,825 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695524424824"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524424824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524424824"}]},"ts":"1695524424824"} 2023-09-24 03:00:24,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 089de905be6ab08bbde884cc9dffe392, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:24,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 03:00:24,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:24,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 089de905be6ab08bbde884cc9dffe392, disabling compactions & flushes 2023-09-24 03:00:24,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:24,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:24,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. after waiting 0 ms 2023-09-24 03:00:24,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:24,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-24 03:00:24,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:25,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392. 2023-09-24 03:00:25,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 089de905be6ab08bbde884cc9dffe392: 2023-09-24 03:00:25,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:25,002 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=089de905be6ab08bbde884cc9dffe392, regionState=CLOSED 2023-09-24 03:00:25,002 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695524425002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524425002"}]},"ts":"1695524425002"} 2023-09-24 03:00:25,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-24 03:00:25,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 089de905be6ab08bbde884cc9dffe392, server=jenkins-hbase20.apache.org,38603,1695524343980 in 177 msec 2023-09-24 03:00:25,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-24 03:00:25,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=089de905be6ab08bbde884cc9dffe392, UNASSIGN in 182 msec 2023-09-24 03:00:25,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524425007"}]},"ts":"1695524425007"} 2023-09-24 03:00:25,008 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-24 03:00:25,009 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-24 03:00:25,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 194 msec 2023-09-24 03:00:25,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 03:00:25,125 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-24 03:00:25,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,134 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,135 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,137 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,139 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,139 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,139 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 03:00:25,140 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 03:00:25,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 03:00:25,140 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:25,140 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,141 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,140 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-24 03:00:25,141 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:25,141 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:25,141 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 03:00:25,141 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:25,142 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:25,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:25,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-24 03:00:25,142 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:25,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:25,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:25,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:25,142 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:25,144 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/recovered.edits] 2023-09-24 03:00:25,144 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/recovered.edits] 2023-09-24 03:00:25,144 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/recovered.edits] 2023-09-24 03:00:25,148 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/81c4f604004842429cd5f1b63d701675.e35053a973e15d7766d2293b59034a4b to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/81c4f604004842429cd5f1b63d701675.e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:25,148 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf/acac091a42624f34b80b5edc471abdd0 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/cf/acac091a42624f34b80b5edc471abdd0 2023-09-24 03:00:25,148 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf/81c4f604004842429cd5f1b63d701675 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/cf/81c4f604004842429cd5f1b63d701675 2023-09-24 03:00:25,149 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/acac091a42624f34b80b5edc471abdd0.728157cb633d8ac1b2d034494f1b5183 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/cf/acac091a42624f34b80b5edc471abdd0.728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:25,151 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/recovered.edits/8.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183/recovered.edits/8.seqid 2023-09-24 03:00:25,151 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/recovered.edits/8.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b/recovered.edits/8.seqid 2023-09-24 03:00:25,151 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728157cb633d8ac1b2d034494f1b5183 2023-09-24 03:00:25,151 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e35053a973e15d7766d2293b59034a4b 2023-09-24 03:00:25,152 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/recovered.edits/12.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392/recovered.edits/12.seqid 2023-09-24 03:00:25,152 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/089de905be6ab08bbde884cc9dffe392 2023-09-24 03:00:25,152 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-24 03:00:25,154 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,156 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-24 03:00:25,158 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-24 03:00:25,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-24 03:00:25,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524425159"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:25,161 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-24 03:00:25,161 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 089de905be6ab08bbde884cc9dffe392, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695524411556.089de905be6ab08bbde884cc9dffe392.', STARTKEY => '', ENDKEY => ''}] 2023-09-24 03:00:25,161 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-24 03:00:25,161 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695524425161"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:25,162 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-24 03:00:25,164 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,165 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 36 msec 2023-09-24 03:00:25,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-24 03:00:25,245 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-24 03:00:25,246 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 03:00:25,256 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524425256"}]},"ts":"1695524425256"} 2023-09-24 03:00:25,258 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-24 03:00:25,259 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-24 03:00:25,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca8625a023ddac5a4669fa090cc4fc9c, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=658fbb7b6c29be8203736429860c5ebc, UNASSIGN}] 2023-09-24 03:00:25,262 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=658fbb7b6c29be8203736429860c5ebc, UNASSIGN 2023-09-24 03:00:25,262 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca8625a023ddac5a4669fa090cc4fc9c, UNASSIGN 2023-09-24 03:00:25,263 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=658fbb7b6c29be8203736429860c5ebc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:25,263 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ca8625a023ddac5a4669fa090cc4fc9c, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:25,263 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524425263"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524425263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524425263"}]},"ts":"1695524425263"} 2023-09-24 03:00:25,263 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524425263"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524425263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524425263"}]},"ts":"1695524425263"} 2023-09-24 03:00:25,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 658fbb7b6c29be8203736429860c5ebc, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:25,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure ca8625a023ddac5a4669fa090cc4fc9c, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 03:00:25,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 03:00:25,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:25,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 658fbb7b6c29be8203736429860c5ebc, disabling compactions & flushes 2023-09-24 03:00:25,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. after waiting 0 ms 2023-09-24 03:00:25,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:25,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ca8625a023ddac5a4669fa090cc4fc9c, disabling compactions & flushes 2023-09-24 03:00:25,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:25,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:25,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. after waiting 0 ms 2023-09-24 03:00:25,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:25,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:00:25,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:00:25,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:25,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc. 2023-09-24 03:00:25,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 658fbb7b6c29be8203736429860c5ebc: 2023-09-24 03:00:25,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:25,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c. 2023-09-24 03:00:25,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ca8625a023ddac5a4669fa090cc4fc9c: 2023-09-24 03:00:25,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:25,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=658fbb7b6c29be8203736429860c5ebc, regionState=CLOSED 2023-09-24 03:00:25,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:25,442 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524425442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524425442"}]},"ts":"1695524425442"} 2023-09-24 03:00:25,442 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ca8625a023ddac5a4669fa090cc4fc9c, regionState=CLOSED 2023-09-24 03:00:25,443 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695524425442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524425442"}]},"ts":"1695524425442"} 2023-09-24 03:00:25,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-24 03:00:25,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 658fbb7b6c29be8203736429860c5ebc, server=jenkins-hbase20.apache.org,38603,1695524343980 in 179 msec 2023-09-24 03:00:25,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-24 03:00:25,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure ca8625a023ddac5a4669fa090cc4fc9c, server=jenkins-hbase20.apache.org,35519,1695524344025 in 180 msec 2023-09-24 03:00:25,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=658fbb7b6c29be8203736429860c5ebc, UNASSIGN in 185 msec 2023-09-24 03:00:25,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-24 03:00:25,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca8625a023ddac5a4669fa090cc4fc9c, UNASSIGN in 186 msec 2023-09-24 03:00:25,447 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524425447"}]},"ts":"1695524425447"} 2023-09-24 03:00:25,448 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-24 03:00:25,449 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-24 03:00:25,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 202 msec 2023-09-24 03:00:25,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 03:00:25,561 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-24 03:00:25,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,570 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,571 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,573 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,575 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,575 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,575 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,575 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 03:00:25,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 03:00:25,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 03:00:25,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 03:00:25,577 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,577 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,577 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,577 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:25,577 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,577 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:25,577 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:25,577 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:25,578 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:25,578 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:25,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-24 03:00:25,580 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/recovered.edits] 2023-09-24 03:00:25,580 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/recovered.edits] 2023-09-24 03:00:25,584 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf/75fc8a9bcc5847e4a6f1161db9c8ea9d to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/cf/75fc8a9bcc5847e4a6f1161db9c8ea9d 2023-09-24 03:00:25,584 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf/cd3e84b630f64bef936db2abaf6b0fb6 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/cf/cd3e84b630f64bef936db2abaf6b0fb6 2023-09-24 03:00:25,586 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c/recovered.edits/9.seqid 2023-09-24 03:00:25,587 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc/recovered.edits/9.seqid 2023-09-24 03:00:25,587 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca8625a023ddac5a4669fa090cc4fc9c 2023-09-24 03:00:25,587 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/658fbb7b6c29be8203736429860c5ebc 2023-09-24 03:00:25,587 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-24 03:00:25,587 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-24 03:00:25,588 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-24 03:00:25,590 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924481c1f3d82f2417fb44f9e79685de817 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924481c1f3d82f2417fb44f9e79685de817 2023-09-24 03:00:25,591 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309248ae311ccc28544209d8e9a694580ce52 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309248ae311ccc28544209d8e9a694580ce52 2023-09-24 03:00:25,591 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-24 03:00:25,593 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,594 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-24 03:00:25,596 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-24 03:00:25,597 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,598 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-24 03:00:25,598 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524425598"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:25,598 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524425598"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:25,599 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 03:00:25,599 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ca8625a023ddac5a4669fa090cc4fc9c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695524410145.ca8625a023ddac5a4669fa090cc4fc9c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 658fbb7b6c29be8203736429860c5ebc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695524410145.658fbb7b6c29be8203736429860c5ebc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 03:00:25,599 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-24 03:00:25,600 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695524425599"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:25,601 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-24 03:00:25,602 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 38 msec 2023-09-24 03:00:25,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-24 03:00:25,681 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-24 03:00:25,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-24 03:00:25,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-24 03:00:25,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 03:00:25,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-24 03:00:25,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 03:00:25,735 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 758) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:42626 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:35946 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2124412131_1 at /127.0.0.1:35930 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:42180 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:44343 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4070 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2124412131_1 at /127.0.0.1:42162 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 172) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 168), AvailableMemoryMB=6681 (was 6758) 2023-09-24 03:00:25,735 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-24 03:00:25,754 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=167, AvailableMemoryMB=6681 2023-09-24 03:00:25,754 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-24 03:00:25,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 03:00:25,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 03:00:25,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 03:00:25,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-24 03:00:25,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 03:00:25,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 03:00:25,761 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:25,761 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:25,762 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5 empty. 2023-09-24 03:00:25,762 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252 empty. 2023-09-24 03:00:25,762 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:25,762 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:25,762 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-24 03:00:25,770 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-24 03:00:25,771 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9fa7892153255f4886c53afaff9d2252, NAME => 'testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 03:00:25,771 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 93c65a2569d7ca53840039a45c511fd5, NAME => 'testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 03:00:25,784 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:25,784 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:25,784 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 93c65a2569d7ca53840039a45c511fd5, disabling compactions & flushes 2023-09-24 03:00:25,784 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9fa7892153255f4886c53afaff9d2252, disabling compactions & flushes 2023-09-24 03:00:25,784 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:25,784 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:25,784 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:25,784 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:25,785 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. after waiting 0 ms 2023-09-24 03:00:25,785 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. after waiting 0 ms 2023-09-24 03:00:25,785 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:25,785 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:25,785 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:25,785 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:25,785 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 93c65a2569d7ca53840039a45c511fd5: 2023-09-24 03:00:25,785 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9fa7892153255f4886c53afaff9d2252: 2023-09-24 03:00:25,787 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 03:00:25,787 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524425787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524425787"}]},"ts":"1695524425787"} 2023-09-24 03:00:25,787 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524425787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524425787"}]},"ts":"1695524425787"} 2023-09-24 03:00:25,789 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 03:00:25,789 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 03:00:25,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524425790"}]},"ts":"1695524425790"} 2023-09-24 03:00:25,791 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-24 03:00:25,793 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 03:00:25,794 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 03:00:25,794 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 03:00:25,794 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 03:00:25,794 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 03:00:25,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93c65a2569d7ca53840039a45c511fd5, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9fa7892153255f4886c53afaff9d2252, ASSIGN}] 2023-09-24 03:00:25,797 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9fa7892153255f4886c53afaff9d2252, ASSIGN 2023-09-24 03:00:25,797 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93c65a2569d7ca53840039a45c511fd5, ASSIGN 2023-09-24 03:00:25,797 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9fa7892153255f4886c53afaff9d2252, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35519,1695524344025; forceNewPlan=false, retain=false 2023-09-24 03:00:25,798 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93c65a2569d7ca53840039a45c511fd5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38603,1695524343980; forceNewPlan=false, retain=false 2023-09-24 03:00:25,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 03:00:25,948 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 03:00:25,954 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=93c65a2569d7ca53840039a45c511fd5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:25,954 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9fa7892153255f4886c53afaff9d2252, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:25,954 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524425954"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524425954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524425954"}]},"ts":"1695524425954"} 2023-09-24 03:00:25,954 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524425954"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524425954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524425954"}]},"ts":"1695524425954"} 2023-09-24 03:00:25,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 93c65a2569d7ca53840039a45c511fd5, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:25,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 9fa7892153255f4886c53afaff9d2252, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 03:00:26,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 03:00:26,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93c65a2569d7ca53840039a45c511fd5, NAME => 'testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. service=AccessControlService 2023-09-24 03:00:26,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9fa7892153255f4886c53afaff9d2252, NAME => 'testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 03:00:26,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. service=AccessControlService 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:26,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:26,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:26,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:26,120 INFO [StoreOpener-9fa7892153255f4886c53afaff9d2252-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:26,120 INFO [StoreOpener-93c65a2569d7ca53840039a45c511fd5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:26,121 DEBUG [StoreOpener-9fa7892153255f4886c53afaff9d2252-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf 2023-09-24 03:00:26,121 DEBUG [StoreOpener-93c65a2569d7ca53840039a45c511fd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf 2023-09-24 03:00:26,121 DEBUG [StoreOpener-9fa7892153255f4886c53afaff9d2252-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf 2023-09-24 03:00:26,121 DEBUG [StoreOpener-93c65a2569d7ca53840039a45c511fd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf 2023-09-24 03:00:26,121 INFO [StoreOpener-9fa7892153255f4886c53afaff9d2252-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fa7892153255f4886c53afaff9d2252 columnFamilyName cf 2023-09-24 03:00:26,121 INFO [StoreOpener-93c65a2569d7ca53840039a45c511fd5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93c65a2569d7ca53840039a45c511fd5 columnFamilyName cf 2023-09-24 03:00:26,123 INFO [StoreOpener-93c65a2569d7ca53840039a45c511fd5-1] regionserver.HStore(310): Store=93c65a2569d7ca53840039a45c511fd5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:26,123 INFO [StoreOpener-9fa7892153255f4886c53afaff9d2252-1] regionserver.HStore(310): Store=9fa7892153255f4886c53afaff9d2252/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:26,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:26,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:26,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:26,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:26,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:26,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:26,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 03:00:26,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 03:00:26,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 93c65a2569d7ca53840039a45c511fd5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68286171, jitterRate=0.017543241381645203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:26,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 93c65a2569d7ca53840039a45c511fd5: 2023-09-24 03:00:26,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9fa7892153255f4886c53afaff9d2252; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64523768, jitterRate=-0.0385209321975708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:26,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9fa7892153255f4886c53afaff9d2252: 2023-09-24 03:00:26,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5., pid=93, masterSystemTime=1695524426110 2023-09-24 03:00:26,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252., pid=94, masterSystemTime=1695524426111 2023-09-24 03:00:26,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,134 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=93c65a2569d7ca53840039a45c511fd5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:26,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524426134"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524426134"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524426134"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524426134"}]},"ts":"1695524426134"} 2023-09-24 03:00:26,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:26,135 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9fa7892153255f4886c53afaff9d2252, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,135 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524426135"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524426135"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524426135"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524426135"}]},"ts":"1695524426135"} 2023-09-24 03:00:26,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-24 03:00:26,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 93c65a2569d7ca53840039a45c511fd5, server=jenkins-hbase20.apache.org,38603,1695524343980 in 179 msec 2023-09-24 03:00:26,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-24 03:00:26,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 9fa7892153255f4886c53afaff9d2252, server=jenkins-hbase20.apache.org,35519,1695524344025 in 178 msec 2023-09-24 03:00:26,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93c65a2569d7ca53840039a45c511fd5, ASSIGN in 343 msec 2023-09-24 03:00:26,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-24 03:00:26,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9fa7892153255f4886c53afaff9d2252, ASSIGN in 344 msec 2023-09-24 03:00:26,140 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 03:00:26,140 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524426140"}]},"ts":"1695524426140"} 2023-09-24 03:00:26,141 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-24 03:00:26,143 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 03:00:26,143 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-24 03:00:26,145 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 03:00:26,145 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:26,145 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:26,145 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:26,145 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:26,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:26,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:26,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:26,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:26,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 390 msec 2023-09-24 03:00:26,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 03:00:26,368 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-24 03:00:26,373 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-24 03:00:26,373 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,375 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 03:00:26,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 03:00:26,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524426392 (current time:1695524426392). 2023-09-24 03:00:26,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 03:00:26,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x6a170297 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:26,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61247727, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:26,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:26,407 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:26,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a170297 to 127.0.0.1:50111 2023-09-24 03:00:26,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:26,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x760cb72c to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:26,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24dd10c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:26,422 DEBUG [hconnection-0x6602c633-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:26,426 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:26,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x760cb72c to 127.0.0.1:50111 2023-09-24 03:00:26,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:26,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 03:00:26,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 03:00:26,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 03:00:26,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 03:00:26,437 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 03:00:26,438 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695525026438 2023-09-24 03:00:26,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 03:00:26,438 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-24 03:00:26,439 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 03:00:26,439 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 03:00:26,440 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 03:00:26,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 03:00:26,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-24 03:00:26,444 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 03:00:26,444 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695525026444 2023-09-24 03:00:26,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,455 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-24 03:00:26,455 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:26,456 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-24 03:00:26,456 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-24 03:00:26,457 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,457 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,459 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,459 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,459 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,459 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,460 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,460 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,460 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,460 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 03:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,461 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 03:00:26,461 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 03:00:26,462 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 03:00:26,462 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:26,462 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:26,463 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 03:00:26,463 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 03:00:26,463 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 03:00:26,464 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 03:00:26,464 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 03:00:26,464 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 03:00:26,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,464 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 03:00:26,464 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:26,465 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 03:00:26,465 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 03:00:26,465 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 03:00:26,468 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,468 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,469 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,469 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,469 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,469 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,469 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,469 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,469 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,470 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,470 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 03:00:26,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60dc832[Count = 1] remaining members to acquire global barrier 2023-09-24 03:00:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 03:00:26,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60dc832[Count = 0] remaining members to acquire global barrier 2023-09-24 03:00:26,474 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 03:00:26,474 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 03:00:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,475 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:26,476 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 03:00:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,476 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:26,476 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 03:00:26,476 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 03:00:26,476 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,476 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 03:00:26,476 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:26,476 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:26,476 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:26,476 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,476 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 03:00:26,476 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. started... 2023-09-24 03:00:26,476 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. started... 2023-09-24 03:00:26,478 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93c65a2569d7ca53840039a45c511fd5: 2023-09-24 03:00:26,478 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9fa7892153255f4886c53afaff9d2252: 2023-09-24 03:00:26,478 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,478 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:26,478 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,478 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 03:00:26,478 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:26,478 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 03:00:26,478 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 03:00:26,478 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:26,478 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 03:00:26,490 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. completed. 2023-09-24 03:00:26,490 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:26,490 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. completed. 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,490 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 03:00:26,490 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 03:00:26,501 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 03:00:26,502 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:26,502 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 03:00:26,502 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,503 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,503 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 03:00:26,503 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:26,503 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 03:00:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,35519,1695524344025': 2023-09-24 03:00:26,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 03:00:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 03:00:26,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 03:00:26,512 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-24 03:00:26,512 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 03:00:26,512 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 03:00:26,512 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,512 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 03:00:26,514 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,514 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,514 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,514 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,514 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,516 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,516 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,516 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,517 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,518 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,521 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,521 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,522 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-24 03:00:26,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,527 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 03:00:26,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,530 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,530 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 03:00:26,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,540 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:26,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 03:00:26,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 03:00:26,541 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 03:00:26,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-24 03:00:26,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,553 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695524426438Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695524426536 (+98 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695524426536Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695524426536Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695524426539 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695524426547 (+8 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695524426553 (+6 ms) 2023-09-24 03:00:26,557 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 03:00:26,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 118 msec 2023-09-24 03:00:26,741 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:26,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 03:00:26,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 03:00:26,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38603] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 03:00:26,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35519] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 03:00:26,755 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-24 03:00:26,755 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,755 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 03:00:26,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 03:00:26,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524426766 (current time:1695524426766). 2023-09-24 03:00:26,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 03:00:26,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x128ace77 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:26,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62c9b14b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:26,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:26,775 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x128ace77 to 127.0.0.1:50111 2023-09-24 03:00:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:26,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x4295d4dc to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:26,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a8538f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:26,880 DEBUG [hconnection-0x2944e9f8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:26,883 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:26,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4295d4dc to 127.0.0.1:50111 2023-09-24 03:00:26,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:26,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 03:00:26,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 03:00:26,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 03:00:26,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 03:00:26,893 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 03:00:26,894 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695525026894 2023-09-24 03:00:26,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-24 03:00:26,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 03:00:26,896 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 03:00:26,896 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 03:00:26,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 03:00:26,897 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 03:00:26,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-24 03:00:26,900 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 03:00:26,900 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695525026900 2023-09-24 03:00:26,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,908 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-24 03:00:26,908 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:26,909 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-24 03:00:26,909 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-24 03:00:26,910 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,910 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,910 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,910 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,910 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:26,910 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:26,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 03:00:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 03:00:26,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 03:00:26,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 03:00:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 03:00:26,913 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:26,913 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 03:00:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 03:00:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 03:00:26,913 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 03:00:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 03:00:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 03:00:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 03:00:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 03:00:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 03:00:26,918 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,918 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,918 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,919 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,919 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,919 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,920 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,920 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:26,920 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:26,920 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,920 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 03:00:26,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d7cfd86[Count = 1] remaining members to acquire global barrier 2023-09-24 03:00:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 03:00:26,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d7cfd86[Count = 0] remaining members to acquire global barrier 2023-09-24 03:00:26,923 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 03:00:26,923 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 03:00:26,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,924 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 03:00:26,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,925 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:26,925 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:26,925 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,925 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 03:00:26,925 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,925 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:26,925 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:26,925 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 03:00:26,925 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. started... 2023-09-24 03:00:26,925 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:26,925 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 03:00:26,925 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. started... 2023-09-24 03:00:26,925 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 03:00:26,925 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 93c65a2569d7ca53840039a45c511fd5 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-24 03:00:26,925 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9fa7892153255f4886c53afaff9d2252 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-24 03:00:26,926 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 03:00:26,926 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:26,926 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 03:00:26,946 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924c945dd4654ab46b9af271863c7103a72 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924c945dd4654ab46b9af271863c7103a72 2023-09-24 03:00:26,946 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924c151c10472e84ab99919cdc47b92c626 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924c151c10472e84ab99919cdc47b92c626 2023-09-24 03:00:26,954 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/.tmp/cf/6404f05acd1643808f03f5ab55085775 2023-09-24 03:00:26,959 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/.tmp/cf/6404f05acd1643808f03f5ab55085775 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf/6404f05acd1643808f03f5ab55085775 2023-09-24 03:00:26,960 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/.tmp/cf/b3e4f98918cf4c5d87168154721f9956 2023-09-24 03:00:26,964 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf/6404f05acd1643808f03f5ab55085775, entries=47, sequenceid=6, filesize=13.1 K 2023-09-24 03:00:26,965 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/.tmp/cf/b3e4f98918cf4c5d87168154721f9956 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf/b3e4f98918cf4c5d87168154721f9956 2023-09-24 03:00:26,965 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 9fa7892153255f4886c53afaff9d2252 in 40ms, sequenceid=6, compaction requested=false 2023-09-24 03:00:26,965 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-24 03:00:26,966 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9fa7892153255f4886c53afaff9d2252: 2023-09-24 03:00:26,966 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,966 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:26,966 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf/6404f05acd1643808f03f5ab55085775] hfiles 2023-09-24 03:00:26,966 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf/6404f05acd1643808f03f5ab55085775 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,969 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf/b3e4f98918cf4c5d87168154721f9956, entries=3, sequenceid=6, filesize=5.4 K 2023-09-24 03:00:26,970 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 93c65a2569d7ca53840039a45c511fd5 in 45ms, sequenceid=6, compaction requested=false 2023-09-24 03:00:26,972 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93c65a2569d7ca53840039a45c511fd5: 2023-09-24 03:00:26,972 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,973 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:26,973 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf/b3e4f98918cf4c5d87168154721f9956] hfiles 2023-09-24 03:00:26,973 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf/b3e4f98918cf4c5d87168154721f9956 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,974 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. completed. 2023-09-24 03:00:26,974 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:26,974 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:26,974 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:26,975 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,975 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 03:00:26,975 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 03:00:26,976 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 03:00:26,976 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,976 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:26,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,976 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 03:00:26,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,35519,1695524344025': 2023-09-24 03:00:26,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 03:00:26,980 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. completed. 2023-09-24 03:00:26,980 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:26,980 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:26,981 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:26,981 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,981 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 03:00:26,981 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 03:00:26,981 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,982 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 03:00:26,982 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:26,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,982 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 03:00:26,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 03:00:26,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 03:00:26,986 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-24 03:00:26,986 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 03:00:26,986 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 03:00:26,986 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,986 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 03:00:26,993 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,993 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,993 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,993 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,993 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,994 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:26,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:26,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,994 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:26,995 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:26,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:26,996 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:26,996 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:26,996 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:26,996 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:26,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:26,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 03:00:26,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 03:00:26,997 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:27,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:27,002 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:27,002 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-24 03:00:27,002 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:27,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:27,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:27,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,002 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:27,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 03:00:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:27,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:27,004 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:27,004 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,005 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:27,005 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:27,005 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:27,005 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:27,005 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,005 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924c151c10472e84ab99919cdc47b92c626, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924c945dd4654ab46b9af271863c7103a72] mob files 2023-09-24 03:00:27,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924c151c10472e84ab99919cdc47b92c626 2023-09-24 03:00:27,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924c945dd4654ab46b9af271863c7103a72 2023-09-24 03:00:27,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-24 03:00:27,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,036 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695524426894Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695524427015 (+121 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695524427015Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695524427015Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695524427019 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695524427027 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695524427035 (+8 ms) 2023-09-24 03:00:27,041 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 03:00:27,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 146 msec 2023-09-24 03:00:27,197 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:27,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 03:00:27,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 03:00:27,201 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201 2023-09-24 03:00:27,201 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42749, tgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201, rawTgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201, srcFsUri=hdfs://localhost:42749, srcDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 03:00:27,224 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 03:00:27,224 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1272789795_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,224 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f, snapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-24 03:00:27,229 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:27,251 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:27,251 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:27,251 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:27,252 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:27,950 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-7629850535255496883.jar 2023-09-24 03:00:27,950 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:27,951 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:28,004 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-6664323783468225258.jar 2023-09-24 03:00:28,004 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:28,004 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:28,005 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:28,005 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:28,005 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:28,006 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:28,006 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 03:00:28,006 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 03:00:28,006 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 03:00:28,007 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 03:00:28,007 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 03:00:28,007 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 03:00:28,008 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 03:00:28,008 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 03:00:28,008 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 03:00:28,009 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 03:00:28,009 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:28,009 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:28,010 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:28,010 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:28,010 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:28,011 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:28,011 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:28,357 WARN [Listener at jenkins-hbase20.apache.org/38347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 03:00:28,359 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-24 03:00:29,183 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 03:00:29,183 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 03:00:29,185 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0005_000001 (auth:SIMPLE) 2023-09-24 03:00:30,019 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0006_000001 (auth:SIMPLE) 2023-09-24 03:00:30,586 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 03:00:33,413 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0006_000001 (auth:SIMPLE) 2023-09-24 03:00:35,705 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 03:00:35,706 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 03:00:35,711 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:35,711 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 03:00:35,712 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 03:00:35,712 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:35,713 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-24 03:00:35,713 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-24 03:00:35,713 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:35,713 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-24 03:00:35,713 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524427201/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-24 03:00:35,718 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-24 03:00:35,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-09-24 03:00:35,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 03:00:35,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 03:00:35,722 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524435722"}]},"ts":"1695524435722"} 2023-09-24 03:00:35,724 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-24 03:00:35,784 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-24 03:00:35,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93c65a2569d7ca53840039a45c511fd5, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9fa7892153255f4886c53afaff9d2252, UNASSIGN}] 2023-09-24 03:00:35,789 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93c65a2569d7ca53840039a45c511fd5, UNASSIGN 2023-09-24 03:00:35,789 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9fa7892153255f4886c53afaff9d2252, UNASSIGN 2023-09-24 03:00:35,789 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=93c65a2569d7ca53840039a45c511fd5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:35,789 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9fa7892153255f4886c53afaff9d2252, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:35,790 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524435789"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524435789"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524435789"}]},"ts":"1695524435789"} 2023-09-24 03:00:35,790 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524435789"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524435789"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524435789"}]},"ts":"1695524435789"} 2023-09-24 03:00:35,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 93c65a2569d7ca53840039a45c511fd5, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:35,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 9fa7892153255f4886c53afaff9d2252, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 03:00:35,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 03:00:35,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:35,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:35,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 93c65a2569d7ca53840039a45c511fd5, disabling compactions & flushes 2023-09-24 03:00:35,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:35,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:35,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. after waiting 0 ms 2023-09-24 03:00:35,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:35,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9fa7892153255f4886c53afaff9d2252, disabling compactions & flushes 2023-09-24 03:00:35,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:35,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:35,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. after waiting 0 ms 2023-09-24 03:00:35,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:35,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:00:35,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:00:35,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:35,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:35,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5. 2023-09-24 03:00:35,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252. 2023-09-24 03:00:35,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 93c65a2569d7ca53840039a45c511fd5: 2023-09-24 03:00:35,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9fa7892153255f4886c53afaff9d2252: 2023-09-24 03:00:35,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:35,964 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=93c65a2569d7ca53840039a45c511fd5, regionState=CLOSED 2023-09-24 03:00:35,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:35,964 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524435964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524435964"}]},"ts":"1695524435964"} 2023-09-24 03:00:35,965 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9fa7892153255f4886c53afaff9d2252, regionState=CLOSED 2023-09-24 03:00:35,965 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695524435965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524435965"}]},"ts":"1695524435965"} 2023-09-24 03:00:35,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-24 03:00:35,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 93c65a2569d7ca53840039a45c511fd5, server=jenkins-hbase20.apache.org,38603,1695524343980 in 175 msec 2023-09-24 03:00:35,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-24 03:00:35,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 9fa7892153255f4886c53afaff9d2252, server=jenkins-hbase20.apache.org,35519,1695524344025 in 175 msec 2023-09-24 03:00:35,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=93c65a2569d7ca53840039a45c511fd5, UNASSIGN in 183 msec 2023-09-24 03:00:35,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-24 03:00:35,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9fa7892153255f4886c53afaff9d2252, UNASSIGN in 184 msec 2023-09-24 03:00:35,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524435971"}]},"ts":"1695524435971"} 2023-09-24 03:00:35,972 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-24 03:00:35,973 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-24 03:00:35,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 254 msec 2023-09-24 03:00:36,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 03:00:36,026 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-24 03:00:36,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,032 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,034 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,036 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,038 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,038 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,038 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,038 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 03:00:36,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 03:00:36,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 03:00:36,040 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:36,040 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:36,042 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/recovered.edits] 2023-09-24 03:00:36,042 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/recovered.edits] 2023-09-24 03:00:36,042 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,042 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,042 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,042 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:36,042 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:36,042 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:36,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-09-24 03:00:36,042 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:36,043 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 03:00:36,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-24 03:00:36,046 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf/6404f05acd1643808f03f5ab55085775 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/cf/6404f05acd1643808f03f5ab55085775 2023-09-24 03:00:36,046 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf/b3e4f98918cf4c5d87168154721f9956 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/cf/b3e4f98918cf4c5d87168154721f9956 2023-09-24 03:00:36,048 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252/recovered.edits/9.seqid 2023-09-24 03:00:36,048 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5/recovered.edits/9.seqid 2023-09-24 03:00:36,049 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/9fa7892153255f4886c53afaff9d2252 2023-09-24 03:00:36,049 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testEmptyExportFileSystemState/93c65a2569d7ca53840039a45c511fd5 2023-09-24 03:00:36,049 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-24 03:00:36,049 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-24 03:00:36,050 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-24 03:00:36,053 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924c151c10472e84ab99919cdc47b92c626 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924c151c10472e84ab99919cdc47b92c626 2023-09-24 03:00:36,054 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924c945dd4654ab46b9af271863c7103a72 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924c945dd4654ab46b9af271863c7103a72 2023-09-24 03:00:36,055 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-24 03:00:36,057 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,059 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-24 03:00:36,061 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-24 03:00:36,062 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,063 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-24 03:00:36,063 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524436063"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:36,063 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524436063"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:36,065 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 03:00:36,065 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 93c65a2569d7ca53840039a45c511fd5, NAME => 'testtb-testEmptyExportFileSystemState,,1695524425756.93c65a2569d7ca53840039a45c511fd5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9fa7892153255f4886c53afaff9d2252, NAME => 'testtb-testEmptyExportFileSystemState,1,1695524425756.9fa7892153255f4886c53afaff9d2252.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 03:00:36,065 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-24 03:00:36,065 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695524436065"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:36,067 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-24 03:00:36,068 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 03:00:36,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 40 msec 2023-09-24 03:00:36,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-24 03:00:36,145 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-24 03:00:36,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-24 03:00:36,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:36,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-24 03:00:36,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-24 03:00:36,176 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 763) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:45525 from appattempt_1695524350049_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:35320 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_104285415_1 at /127.0.0.1:33524 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:33554 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:43767 from appattempt_1695524350049_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:46495 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4840 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:60542 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 173), ProcessCount=167 (was 167), AvailableMemoryMB=6599 (was 6681) 2023-09-24 03:00:36,177 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-24 03:00:36,193 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=161, ProcessCount=167, AvailableMemoryMB=6599 2023-09-24 03:00:36,193 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-24 03:00:36,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 03:00:36,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,198 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 03:00:36,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-24 03:00:36,198 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 03:00:36,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 03:00:36,200 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,200 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,201 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb empty. 2023-09-24 03:00:36,201 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85 empty. 2023-09-24 03:00:36,201 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,201 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,201 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-24 03:00:36,211 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-24 03:00:36,212 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 69ca086a11c52f3d9b0cd0793ac0bb85, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 03:00:36,212 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6316c509313d56681867f5df1d3d31cb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp 2023-09-24 03:00:36,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:36,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 69ca086a11c52f3d9b0cd0793ac0bb85, disabling compactions & flushes 2023-09-24 03:00:36,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. after waiting 0 ms 2023-09-24 03:00:36,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 69ca086a11c52f3d9b0cd0793ac0bb85: 2023-09-24 03:00:36,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:36,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 6316c509313d56681867f5df1d3d31cb, disabling compactions & flushes 2023-09-24 03:00:36,223 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. after waiting 0 ms 2023-09-24 03:00:36,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,223 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 6316c509313d56681867f5df1d3d31cb: 2023-09-24 03:00:36,225 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 03:00:36,226 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524436226"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524436226"}]},"ts":"1695524436226"} 2023-09-24 03:00:36,226 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524436226"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524436226"}]},"ts":"1695524436226"} 2023-09-24 03:00:36,228 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 03:00:36,229 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 03:00:36,229 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524436229"}]},"ts":"1695524436229"} 2023-09-24 03:00:36,230 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-24 03:00:36,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-24 03:00:36,233 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 03:00:36,234 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 03:00:36,234 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 03:00:36,234 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 03:00:36,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ca086a11c52f3d9b0cd0793ac0bb85, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6316c509313d56681867f5df1d3d31cb, ASSIGN}] 2023-09-24 03:00:36,236 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6316c509313d56681867f5df1d3d31cb, ASSIGN 2023-09-24 03:00:36,236 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ca086a11c52f3d9b0cd0793ac0bb85, ASSIGN 2023-09-24 03:00:36,237 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ca086a11c52f3d9b0cd0793ac0bb85, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38603,1695524343980; forceNewPlan=false, retain=false 2023-09-24 03:00:36,237 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6316c509313d56681867f5df1d3d31cb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35519,1695524344025; forceNewPlan=false, retain=false 2023-09-24 03:00:36,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 03:00:36,387 INFO [jenkins-hbase20:34295] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 03:00:36,390 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6316c509313d56681867f5df1d3d31cb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,390 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=69ca086a11c52f3d9b0cd0793ac0bb85, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,390 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524436390"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524436390"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524436390"}]},"ts":"1695524436390"} 2023-09-24 03:00:36,390 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524436390"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524436390"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524436390"}]},"ts":"1695524436390"} 2023-09-24 03:00:36,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 69ca086a11c52f3d9b0cd0793ac0bb85, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:36,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 6316c509313d56681867f5df1d3d31cb, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 03:00:36,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 03:00:36,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69ca086a11c52f3d9b0cd0793ac0bb85, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 03:00:36,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6316c509313d56681867f5df1d3d31cb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. service=AccessControlService 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. service=AccessControlService 2023-09-24 03:00:36,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:36,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,548 INFO [StoreOpener-69ca086a11c52f3d9b0cd0793ac0bb85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,548 INFO [StoreOpener-6316c509313d56681867f5df1d3d31cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,549 DEBUG [StoreOpener-69ca086a11c52f3d9b0cd0793ac0bb85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf 2023-09-24 03:00:36,549 DEBUG [StoreOpener-6316c509313d56681867f5df1d3d31cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf 2023-09-24 03:00:36,549 DEBUG [StoreOpener-69ca086a11c52f3d9b0cd0793ac0bb85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf 2023-09-24 03:00:36,549 DEBUG [StoreOpener-6316c509313d56681867f5df1d3d31cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf 2023-09-24 03:00:36,550 INFO [StoreOpener-69ca086a11c52f3d9b0cd0793ac0bb85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69ca086a11c52f3d9b0cd0793ac0bb85 columnFamilyName cf 2023-09-24 03:00:36,550 INFO [StoreOpener-6316c509313d56681867f5df1d3d31cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6316c509313d56681867f5df1d3d31cb columnFamilyName cf 2023-09-24 03:00:36,551 INFO [StoreOpener-6316c509313d56681867f5df1d3d31cb-1] regionserver.HStore(310): Store=6316c509313d56681867f5df1d3d31cb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:36,551 INFO [StoreOpener-69ca086a11c52f3d9b0cd0793ac0bb85-1] regionserver.HStore(310): Store=69ca086a11c52f3d9b0cd0793ac0bb85/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 03:00:36,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:36,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:36,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 03:00:36,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 03:00:36,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 69ca086a11c52f3d9b0cd0793ac0bb85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70127216, jitterRate=0.04497694969177246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:36,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6316c509313d56681867f5df1d3d31cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59499253, jitterRate=-0.11339204013347626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 03:00:36,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 69ca086a11c52f3d9b0cd0793ac0bb85: 2023-09-24 03:00:36,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6316c509313d56681867f5df1d3d31cb: 2023-09-24 03:00:36,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85., pid=108, masterSystemTime=1695524436543 2023-09-24 03:00:36,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb., pid=109, masterSystemTime=1695524436543 2023-09-24 03:00:36,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,559 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=69ca086a11c52f3d9b0cd0793ac0bb85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,559 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524436559"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524436559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524436559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524436559"}]},"ts":"1695524436559"} 2023-09-24 03:00:36,560 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6316c509313d56681867f5df1d3d31cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,560 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524436560"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695524436560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695524436560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695524436560"}]},"ts":"1695524436560"} 2023-09-24 03:00:36,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-24 03:00:36,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 69ca086a11c52f3d9b0cd0793ac0bb85, server=jenkins-hbase20.apache.org,38603,1695524343980 in 169 msec 2023-09-24 03:00:36,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-24 03:00:36,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 6316c509313d56681867f5df1d3d31cb, server=jenkins-hbase20.apache.org,35519,1695524344025 in 169 msec 2023-09-24 03:00:36,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ca086a11c52f3d9b0cd0793ac0bb85, ASSIGN in 329 msec 2023-09-24 03:00:36,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-24 03:00:36,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6316c509313d56681867f5df1d3d31cb, ASSIGN in 329 msec 2023-09-24 03:00:36,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 03:00:36,566 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524436565"}]},"ts":"1695524436565"} 2023-09-24 03:00:36,567 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-24 03:00:36,569 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 03:00:36,569 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-24 03:00:36,571 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 03:00:36,572 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:36,572 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:36,572 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:36,572 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:36,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:36,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:36,573 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:36,573 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 03:00:36,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 378 msec 2023-09-24 03:00:36,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 03:00:36,802 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-24 03:00:36,805 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,805 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,808 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 03:00:36,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 03:00:36,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524436825 (current time:1695524436825). 2023-09-24 03:00:36,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 03:00:36,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x68816c60 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:36,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1565549f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:36,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:36,841 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:36,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68816c60 to 127.0.0.1:50111 2023-09-24 03:00:36,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:36,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x334bab99 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:36,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@504a33fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:36,854 DEBUG [hconnection-0x6fb454c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:36,855 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:36,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x334bab99 to 127.0.0.1:50111 2023-09-24 03:00:36,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:36,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 03:00:36,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 03:00:36,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 03:00:36,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 03:00:36,867 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 03:00:36,868 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695525036868 2023-09-24 03:00:36,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 03:00:36,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,870 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 03:00:36,870 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 03:00:36,872 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 03:00:36,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 03:00:36,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-09-24 03:00:36,874 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 03:00:36,874 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695525036874 2023-09-24 03:00:36,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,882 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-24 03:00:36,882 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:36,883 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-24 03:00:36,883 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-24 03:00:36,884 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,884 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,887 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:36,887 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:36,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:36,887 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:36,887 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:36,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,887 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,887 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,888 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,888 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,888 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 03:00:36,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 03:00:36,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 03:00:36,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,889 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 03:00:36,889 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 03:00:36,889 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:36,889 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 03:00:36,890 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 03:00:36,891 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 03:00:36,891 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 03:00:36,889 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:36,890 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:36,892 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 03:00:36,893 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 03:00:36,893 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 03:00:36,893 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 03:00:36,893 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 03:00:36,893 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 03:00:36,897 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,897 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:36,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:36,897 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,897 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,897 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,897 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,897 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:36,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:36,898 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,898 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:36,898 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,898 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:36,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:36,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:36,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 03:00:36,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b2370c1[Count = 1] remaining members to acquire global barrier 2023-09-24 03:00:36,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:36,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:36,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 03:00:36,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b2370c1[Count = 0] remaining members to acquire global barrier 2023-09-24 03:00:36,903 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-24 03:00:36,903 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,910 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,910 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,910 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,911 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 03:00:36,911 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 03:00:36,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,911 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:36,911 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:36,911 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 03:00:36,911 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:36,911 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:36,911 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. started... 2023-09-24 03:00:36,911 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,911 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 03:00:36,911 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:36,911 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 03:00:36,912 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 03:00:36,911 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69ca086a11c52f3d9b0cd0793ac0bb85: 2023-09-24 03:00:36,911 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. started... 2023-09-24 03:00:36,912 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,913 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6316c509313d56681867f5df1d3d31cb: 2023-09-24 03:00:36,914 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:36,914 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 03:00:36,914 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,914 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:36,914 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 03:00:36,915 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 03:00:36,915 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:36,915 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 03:00:36,931 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. completed. 2023-09-24 03:00:36,931 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:36,931 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:36,931 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:36,931 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,931 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 03:00:36,931 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 03:00:36,938 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,938 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 03:00:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:36,939 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:36,939 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 03:00:36,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:36,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:36,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:36,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:36,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:36,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:36,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,35519,1695524344025': 2023-09-24 03:00:36,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-24 03:00:36,970 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:36,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 03:00:36,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-24 03:00:36,972 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 03:00:37,172 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:37,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 03:00:37,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-24 03:00:37,175 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-24 03:00:37,331 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. completed. 2023-09-24 03:00:37,331 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:37,332 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:37,332 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:37,332 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,332 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 03:00:37,332 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 03:00:37,334 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,334 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 03:00:37,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:37,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:37,334 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:37,334 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 03:00:37,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:37,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:37,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 03:00:37,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-24 03:00:37,343 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-24 03:00:37,343 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 03:00:37,343 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 03:00:37,343 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,343 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 03:00:37,347 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,347 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,347 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,347 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,347 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,347 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,348 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,348 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:37,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:37,348 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:37,349 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:37,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,351 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,351 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:37,352 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,359 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,360 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,360 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,360 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,360 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,359 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,360 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,360 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:37,360 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,361 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,360 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 03:00:37,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,361 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,362 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,362 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,362 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,363 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,363 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 03:00:37,363 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-24 03:00:37,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,389 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695524436868Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695524437374 (+506 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695524437374Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695524437374Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695524437378 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695524437384 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695524437389 (+5 ms) 2023-09-24 03:00:37,392 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 03:00:37,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 522 msec 2023-09-24 03:00:37,476 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:37,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 03:00:37,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 03:00:37,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38603] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 03:00:37,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35519] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 03:00:37,487 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,488 DEBUG [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:37,488 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 03:00:37,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 03:00:37,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695524437498 (current time:1695524437498). 2023-09-24 03:00:37,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 03:00:37,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x73d91db1 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:37,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e066568, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:37,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:37,509 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:37,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73d91db1 to 127.0.0.1:50111 2023-09-24 03:00:37,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:37,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(139): Connect 0x1be1e7a0 to 127.0.0.1:50111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 03:00:37,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@206e55f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 03:00:37,518 DEBUG [hconnection-0x2dce59b8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 03:00:37,522 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 03:00:37,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1be1e7a0 to 127.0.0.1:50111 2023-09-24 03:00:37,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:00:37,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 03:00:37,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 03:00:37,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 03:00:37,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 03:00:37,533 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 03:00:37,533 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695525037533 2023-09-24 03:00:37,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 03:00:37,535 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 03:00:37,535 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 03:00:37,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 03:00:37,536 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 03:00:37,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-09-24 03:00:37,539 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 03:00:37,539 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695525037539 2023-09-24 03:00:37,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,547 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-24 03:00:37,547 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:37,549 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-24 03:00:37,549 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-24 03:00:37,549 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,549 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,550 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,550 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,551 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,551 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,551 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 03:00:37,552 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 03:00:37,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 03:00:37,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,552 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:37,552 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 03:00:37,553 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 03:00:37,553 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 03:00:37,553 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:37,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,554 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 03:00:37,554 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 03:00:37,554 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 03:00:37,553 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 03:00:37,555 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 03:00:37,555 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 03:00:37,555 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37585,1695524344064' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 03:00:37,554 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 03:00:37,555 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 03:00:37,556 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:37,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:37,556 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,556 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,557 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,557 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,557 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:37,557 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,557 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:37,557 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:37,557 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,557 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 03:00:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:37,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35519,1695524344025' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 03:00:37,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18759907[Count = 1] remaining members to acquire global barrier 2023-09-24 03:00:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:37,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38603,1695524343980' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 03:00:37,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18759907[Count = 0] remaining members to acquire global barrier 2023-09-24 03:00:37,561 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-24 03:00:37,561 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,562 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 03:00:37,562 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 03:00:37,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,562 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:37,562 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 03:00:37,562 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:37,562 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 03:00:37,562 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 03:00:37,562 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,562 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 03:00:37,562 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:37,562 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:37,563 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. started... 2023-09-24 03:00:37,562 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 03:00:37,563 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,37585,1695524344064' in zk 2023-09-24 03:00:37,563 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. started... 2023-09-24 03:00:37,563 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 69ca086a11c52f3d9b0cd0793ac0bb85 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-24 03:00:37,563 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6316c509313d56681867f5df1d3d31cb 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-24 03:00:37,564 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 03:00:37,564 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:37,564 DEBUG [member: 'jenkins-hbase20.apache.org,37585,1695524344064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 03:00:37,582 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924ca1e74764f3d458185c7d667148fe46b to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924ca1e74764f3d458185c7d667148fe46b 2023-09-24 03:00:37,583 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924f05a7657d9e94d9b932eb57017c046dc to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924f05a7657d9e94d9b932eb57017c046dc 2023-09-24 03:00:37,595 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/.tmp/cf/f3cbbcde9ad44a52836f70ea375c0ce5 2023-09-24 03:00:37,596 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/.tmp/cf/ef8b7923b34d4c56835e57b1d382086a 2023-09-24 03:00:37,600 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/.tmp/cf/ef8b7923b34d4c56835e57b1d382086a as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf/ef8b7923b34d4c56835e57b1d382086a 2023-09-24 03:00:37,600 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/.tmp/cf/f3cbbcde9ad44a52836f70ea375c0ce5 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf/f3cbbcde9ad44a52836f70ea375c0ce5 2023-09-24 03:00:37,604 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf/ef8b7923b34d4c56835e57b1d382086a, entries=4, sequenceid=6, filesize=5.6 K 2023-09-24 03:00:37,604 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf/f3cbbcde9ad44a52836f70ea375c0ce5, entries=46, sequenceid=6, filesize=13.2 K 2023-09-24 03:00:37,605 INFO [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 69ca086a11c52f3d9b0cd0793ac0bb85 in 42ms, sequenceid=6, compaction requested=false 2023-09-24 03:00:37,605 INFO [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6316c509313d56681867f5df1d3d31cb in 42ms, sequenceid=6, compaction requested=false 2023-09-24 03:00:37,605 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-24 03:00:37,605 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69ca086a11c52f3d9b0cd0793ac0bb85: 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6316c509313d56681867f5df1d3d31cb: 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf/ef8b7923b34d4c56835e57b1d382086a] hfiles 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf/f3cbbcde9ad44a52836f70ea375c0ce5] hfiles 2023-09-24 03:00:37,609 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf/f3cbbcde9ad44a52836f70ea375c0ce5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,608 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf/ef8b7923b34d4c56835e57b1d382086a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,624 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. completed. 2023-09-24 03:00:37,624 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. completed. 2023-09-24 03:00:37,624 DEBUG [rs(jenkins-hbase20.apache.org,38603,1695524343980)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:37,624 DEBUG [rs(jenkins-hbase20.apache.org,35519,1695524344025)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38603,1695524343980' in zk 2023-09-24 03:00:37,624 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,35519,1695524344025' in zk 2023-09-24 03:00:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 03:00:37,625 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:37,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:37,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,35519,1695524344025' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 03:00:37,627 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,627 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 03:00:37,627 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:37,627 DEBUG [member: 'jenkins-hbase20.apache.org,38603,1695524343980' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 03:00:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,35519,1695524344025': 2023-09-24 03:00:37,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35519,1695524344025' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-24 03:00:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38603,1695524343980': 2023-09-24 03:00:37,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38603,1695524343980' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-24 03:00:37,633 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-24 03:00:37,633 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 03:00:37,633 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 03:00:37,633 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,634 INFO [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 03:00:37,635 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:37,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 03:00:37,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-24 03:00:37,636 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 03:00:37,638 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,638 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,638 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,638 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,639 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,638 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,639 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 03:00:37,639 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,639 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 03:00:37,640 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 03:00:37,641 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,642 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,642 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,647 DEBUG [(jenkins-hbase20.apache.org,34295,1695524342827)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 03:00:37,647 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 03:00:37,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 03:00:37,649 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:37,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,650 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 03:00:37,650 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:37,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 03:00:37,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 03:00:37,650 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:00:37,650 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,650 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924ca1e74764f3d458185c7d667148fe46b, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924f05a7657d9e94d9b932eb57017c046dc] mob files 2023-09-24 03:00:37,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924ca1e74764f3d458185c7d667148fe46b 2023-09-24 03:00:37,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924f05a7657d9e94d9b932eb57017c046dc 2023-09-24 03:00:37,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-24 03:00:37,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,679 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695524437533Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695524437660 (+127 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695524437660Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695524437660Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695524437664 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695524437671 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695524437678 (+7 ms) 2023-09-24 03:00:37,682 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 03:00:37,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 147 msec 2023-09-24 03:00:37,836 DEBUG [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 03:00:37,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 03:00:37,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 03:00:37,839 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839 2023-09-24 03:00:37,840 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42749, tgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839, rawTgtDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839, srcFsUri=hdfs://localhost:42749, srcDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 03:00:37,863 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f 2023-09-24 03:00:37,863 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-982735260_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,863 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42749, inputRoot=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f, snapshotDir=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-24 03:00:37,874 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:37,888 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:37,888 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:37,889 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:37,889 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,589 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-6295372939004911172.jar 2023-09-24 03:00:38,590 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,590 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,643 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/hadoop-5468322827386618061.jar 2023-09-24 03:00:38,643 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,644 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,644 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,644 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,645 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,645 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 03:00:38,645 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 03:00:38,646 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 03:00:38,646 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 03:00:38,646 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 03:00:38,646 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 03:00:38,647 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 03:00:38,647 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 03:00:38,647 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 03:00:38,647 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 03:00:38,648 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 03:00:38,648 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:38,649 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:38,649 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:38,649 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:38,649 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 03:00:38,650 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:38,650 DEBUG [Listener at jenkins-hbase20.apache.org/38347] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 03:00:39,004 WARN [Listener at jenkins-hbase20.apache.org/38347] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 03:00:39,006 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-24 03:00:39,007 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-24 03:00:40,732 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 03:00:40,732 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 03:00:40,734 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0006_000001 (auth:SIMPLE) 2023-09-24 03:00:41,201 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0007_000001 (auth:SIMPLE) 2023-09-24 03:00:41,527 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 03:00:44,506 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0007_000001 (auth:SIMPLE) 2023-09-24 03:00:46,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0007_000001 (auth:SIMPLE) 2023-09-24 03:00:49,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695524350049_0007_000001 (auth:SIMPLE) 2023-09-24 03:00:51,185 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 03:00:51,185 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 03:00:51,195 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,195 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 03:00:51,196 INFO [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 03:00:51,196 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,196 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-24 03:00:51,196 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-24 03:00:51,196 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2105802866_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,197 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-24 03:00:51,197 DEBUG [Listener at jenkins-hbase20.apache.org/38347] snapshot.TestExportSnapshot(367): hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/export-test/export-1695524437839/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-24 03:00:51,202 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 03:00:51,206 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524451206"}]},"ts":"1695524451206"} 2023-09-24 03:00:51,207 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-24 03:00:51,208 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-24 03:00:51,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ca086a11c52f3d9b0cd0793ac0bb85, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6316c509313d56681867f5df1d3d31cb, UNASSIGN}] 2023-09-24 03:00:51,210 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6316c509313d56681867f5df1d3d31cb, UNASSIGN 2023-09-24 03:00:51,211 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ca086a11c52f3d9b0cd0793ac0bb85, UNASSIGN 2023-09-24 03:00:51,211 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=69ca086a11c52f3d9b0cd0793ac0bb85, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:00:51,211 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6316c509313d56681867f5df1d3d31cb, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:00:51,211 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524451211"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524451211"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524451211"}]},"ts":"1695524451211"} 2023-09-24 03:00:51,211 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524451211"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695524451211"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695524451211"}]},"ts":"1695524451211"} 2023-09-24 03:00:51,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 69ca086a11c52f3d9b0cd0793ac0bb85, server=jenkins-hbase20.apache.org,38603,1695524343980}] 2023-09-24 03:00:51,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 6316c509313d56681867f5df1d3d31cb, server=jenkins-hbase20.apache.org,35519,1695524344025}] 2023-09-24 03:00:51,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 03:00:51,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:51,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:51,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 69ca086a11c52f3d9b0cd0793ac0bb85, disabling compactions & flushes 2023-09-24 03:00:51,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6316c509313d56681867f5df1d3d31cb, disabling compactions & flushes 2023-09-24 03:00:51,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:51,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:51,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:51,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:51,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. after waiting 0 ms 2023-09-24 03:00:51,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. after waiting 0 ms 2023-09-24 03:00:51,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:51,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:51,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:00:51,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:00:51,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:51,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:00:51,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb. 2023-09-24 03:00:51,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85. 2023-09-24 03:00:51,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6316c509313d56681867f5df1d3d31cb: 2023-09-24 03:00:51,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 69ca086a11c52f3d9b0cd0793ac0bb85: 2023-09-24 03:00:51,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:51,387 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6316c509313d56681867f5df1d3d31cb, regionState=CLOSED 2023-09-24 03:00:51,387 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524451387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524451387"}]},"ts":"1695524451387"} 2023-09-24 03:00:51,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:51,388 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=69ca086a11c52f3d9b0cd0793ac0bb85, regionState=CLOSED 2023-09-24 03:00:51,388 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695524451388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695524451388"}]},"ts":"1695524451388"} 2023-09-24 03:00:51,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-24 03:00:51,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 6316c509313d56681867f5df1d3d31cb, server=jenkins-hbase20.apache.org,35519,1695524344025 in 176 msec 2023-09-24 03:00:51,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-24 03:00:51,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6316c509313d56681867f5df1d3d31cb, UNASSIGN in 181 msec 2023-09-24 03:00:51,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 69ca086a11c52f3d9b0cd0793ac0bb85, server=jenkins-hbase20.apache.org,38603,1695524343980 in 178 msec 2023-09-24 03:00:51,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-24 03:00:51,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69ca086a11c52f3d9b0cd0793ac0bb85, UNASSIGN in 184 msec 2023-09-24 03:00:51,395 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695524451395"}]},"ts":"1695524451395"} 2023-09-24 03:00:51,396 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-24 03:00:51,397 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-24 03:00:51,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-09-24 03:00:51,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 03:00:51,510 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-24 03:00:51,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,517 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,519 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,521 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37585] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,523 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,523 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,523 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,523 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 03:00:51,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 03:00:51,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 03:00:51,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:51,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:51,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:51,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 03:00:51,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-24 03:00:51,526 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 03:00:51,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-24 03:00:51,527 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:51,527 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:51,529 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/recovered.edits] 2023-09-24 03:00:51,529 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf, FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/recovered.edits] 2023-09-24 03:00:51,532 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf/ef8b7923b34d4c56835e57b1d382086a to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/cf/ef8b7923b34d4c56835e57b1d382086a 2023-09-24 03:00:51,532 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf/f3cbbcde9ad44a52836f70ea375c0ce5 to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/cf/f3cbbcde9ad44a52836f70ea375c0ce5 2023-09-24 03:00:51,534 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85/recovered.edits/9.seqid 2023-09-24 03:00:51,534 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/recovered.edits/9.seqid to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb/recovered.edits/9.seqid 2023-09-24 03:00:51,534 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69ca086a11c52f3d9b0cd0793ac0bb85 2023-09-24 03:00:51,534 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6316c509313d56681867f5df1d3d31cb 2023-09-24 03:00:51,534 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-24 03:00:51,534 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-24 03:00:51,535 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-24 03:00:51,537 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924ca1e74764f3d458185c7d667148fe46b to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924ca1e74764f3d458185c7d667148fe46b 2023-09-24 03:00:51,538 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924f05a7657d9e94d9b932eb57017c046dc to hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924f05a7657d9e94d9b932eb57017c046dc 2023-09-24 03:00:51,538 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-24 03:00:51,540 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,542 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-24 03:00:51,543 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-24 03:00:51,544 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,544 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-24 03:00:51,544 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524451544"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:51,544 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695524451544"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:51,546 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 03:00:51,546 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 69ca086a11c52f3d9b0cd0793ac0bb85, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695524436194.69ca086a11c52f3d9b0cd0793ac0bb85.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6316c509313d56681867f5df1d3d31cb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695524436194.6316c509313d56681867f5df1d3d31cb.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 03:00:51,546 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-24 03:00:51,546 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695524451546"}]},"ts":"9223372036854775807"} 2023-09-24 03:00:51,547 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-24 03:00:51,548 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 36 msec 2023-09-24 03:00:51,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-24 03:00:51,629 INFO [Listener at jenkins-hbase20.apache.org/38347] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-24 03:00:51,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-24 03:00:51,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-24 03:00:51,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34295] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 03:00:51,680 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 765) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:55564 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:54868 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase20.apache.org/148.251.75.209:46043 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5448 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1341398368_1 at /127.0.0.1:54828 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2105802866_17 at /127.0.0.1:46768 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1341398368_1 at /127.0.0.1:46742 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e78051c-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=133 (was 161), ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=6473 (was 6599) 2023-09-24 03:00:51,680 WARN [Listener at jenkins-hbase20.apache.org/38347] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-24 03:00:51,680 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-24 03:00:51,688 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-24 03:00:51,809 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695524350049_0007_01_000001 is : 143 2023-09-24 03:00:56,955 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 03:01:05,823 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-24 03:01:19,951 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 03:01:19,952 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-24 03:01:20,065 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-24 03:01:20,072 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-24 03:01:20,073 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 03:01:20,078 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-24 03:01:20,183 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 03:01:20,183 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-24 03:01:20,183 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-24 03:01:20,183 INFO [Listener at jenkins-hbase20.apache.org/38347] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-24 03:01:20,184 DEBUG [Listener at jenkins-hbase20.apache.org/38347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bcaf3c7 to 127.0.0.1:50111 2023-09-24 03:01:20,184 DEBUG [Listener at jenkins-hbase20.apache.org/38347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,184 DEBUG [Listener at jenkins-hbase20.apache.org/38347] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-24 03:01:20,184 DEBUG [Listener at jenkins-hbase20.apache.org/38347] util.JVMClusterUtil(257): Found active master hash=1106632701, stopped=false 2023-09-24 03:01:20,185 DEBUG [Listener at jenkins-hbase20.apache.org/38347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:01:20,185 DEBUG [Listener at jenkins-hbase20.apache.org/38347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-24 03:01:20,185 INFO [Listener at jenkins-hbase20.apache.org/38347] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 03:01:20,187 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 03:01:20,187 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 03:01:20,187 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 03:01:20,187 INFO [Listener at jenkins-hbase20.apache.org/38347] procedure2.ProcedureExecutor(628): Stopping 2023-09-24 03:01:20,187 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 03:01:20,188 DEBUG [Listener at jenkins-hbase20.apache.org/38347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x583c0f63 to 127.0.0.1:50111 2023-09-24 03:01:20,188 DEBUG [Listener at jenkins-hbase20.apache.org/38347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 03:01:20,189 INFO [Listener at jenkins-hbase20.apache.org/38347] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38603,1695524343980' ***** 2023-09-24 03:01:20,187 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 03:01:20,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 03:01:20,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 03:01:20,189 DEBUG [Listener at jenkins-hbase20.apache.org/38347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:01:20,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 03:01:20,189 INFO [Listener at jenkins-hbase20.apache.org/38347] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 03:01:20,189 INFO [Listener at jenkins-hbase20.apache.org/38347] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,35519,1695524344025' ***** 2023-09-24 03:01:20,189 DEBUG [Listener at jenkins-hbase20.apache.org/38347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:01:20,190 INFO [RS:0;jenkins-hbase20:38603] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 03:01:20,190 INFO [Listener at jenkins-hbase20.apache.org/38347] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 03:01:20,190 INFO [Listener at jenkins-hbase20.apache.org/38347] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,37585,1695524344064' ***** 2023-09-24 03:01:20,190 INFO [RS:0;jenkins-hbase20:38603] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 03:01:20,190 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 03:01:20,190 INFO [RS:0;jenkins-hbase20:38603] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 03:01:20,190 DEBUG [Listener at jenkins-hbase20.apache.org/38347] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:01:20,190 INFO [RS:1;jenkins-hbase20:35519] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 03:01:20,190 INFO [Listener at jenkins-hbase20.apache.org/38347] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 03:01:20,190 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 03:01:20,190 INFO [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:01:20,191 INFO [RS:2;jenkins-hbase20:37585] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 03:01:20,190 INFO [RS:1;jenkins-hbase20:35519] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 03:01:20,191 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 03:01:20,191 INFO [RS:1;jenkins-hbase20:35519] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 03:01:20,191 INFO [RS:2;jenkins-hbase20:37585] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 03:01:20,191 DEBUG [RS:0;jenkins-hbase20:38603] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x546593a5 to 127.0.0.1:50111 2023-09-24 03:01:20,191 INFO [RS:2;jenkins-hbase20:37585] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 03:01:20,191 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(3305): Received CLOSE for 1a79167d2d70acb808658c34229d25ed 2023-09-24 03:01:20,191 DEBUG [RS:0;jenkins-hbase20:38603] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,191 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(3305): Received CLOSE for 11b6caa21568f4c9b7647ba9b24ca193 2023-09-24 03:01:20,192 INFO [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38603,1695524343980; all regions closed. 2023-09-24 03:01:20,192 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:01:20,192 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:01:20,192 DEBUG [RS:1;jenkins-hbase20:35519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c3abd8e to 127.0.0.1:50111 2023-09-24 03:01:20,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1a79167d2d70acb808658c34229d25ed, disabling compactions & flushes 2023-09-24 03:01:20,192 DEBUG [RS:2;jenkins-hbase20:37585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52638b55 to 127.0.0.1:50111 2023-09-24 03:01:20,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 03:01:20,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 11b6caa21568f4c9b7647ba9b24ca193, disabling compactions & flushes 2023-09-24 03:01:20,193 DEBUG [RS:1;jenkins-hbase20:35519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 03:01:20,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 03:01:20,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. after waiting 0 ms 2023-09-24 03:01:20,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 03:01:20,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 03:01:20,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 11b6caa21568f4c9b7647ba9b24ca193 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-24 03:01:20,193 DEBUG [RS:2;jenkins-hbase20:37585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. after waiting 0 ms 2023-09-24 03:01:20,195 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-24 03:01:20,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 03:01:20,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1a79167d2d70acb808658c34229d25ed 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-24 03:01:20,196 INFO [RS:2;jenkins-hbase20:37585] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 03:01:20,196 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1478): Online Regions={1a79167d2d70acb808658c34229d25ed=hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed.} 2023-09-24 03:01:20,196 INFO [RS:2;jenkins-hbase20:37585] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 03:01:20,196 INFO [RS:2;jenkins-hbase20:37585] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 03:01:20,196 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-24 03:01:20,197 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-24 03:01:20,197 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 11b6caa21568f4c9b7647ba9b24ca193=hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193.} 2023-09-24 03:01:20,199 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-24 03:01:20,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-24 03:01:20,199 DEBUG [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1504): Waiting on 11b6caa21568f4c9b7647ba9b24ca193, 1588230740 2023-09-24 03:01:20,199 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-24 03:01:20,199 DEBUG [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1504): Waiting on 1a79167d2d70acb808658c34229d25ed 2023-09-24 03:01:20,199 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-24 03:01:20,199 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-24 03:01:20,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-09-24 03:01:20,217 DEBUG [RS:0;jenkins-hbase20:38603] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/oldWALs 2023-09-24 03:01:20,217 INFO [RS:0;jenkins-hbase20:38603] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38603%2C1695524343980:(num 1695524345594) 2023-09-24 03:01:20,218 DEBUG [RS:0;jenkins-hbase20:38603] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,218 INFO [RS:0;jenkins-hbase20:38603] regionserver.LeaseManager(133): Closed leases 2023-09-24 03:01:20,219 INFO [RS:0;jenkins-hbase20:38603] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-24 03:01:20,222 INFO [RS:0;jenkins-hbase20:38603] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 03:01:20,222 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 03:01:20,222 INFO [RS:0;jenkins-hbase20:38603] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 03:01:20,222 INFO [RS:0;jenkins-hbase20:38603] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 03:01:20,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed/.tmp/info/34b144c3864241a39c543eaa36111ad6 2023-09-24 03:01:20,240 INFO [RS:0;jenkins-hbase20:38603] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38603 2023-09-24 03:01:20,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193/.tmp/l/b34ea2205ca045fe93d233d9d22ad681 2023-09-24 03:01:20,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed/.tmp/info/34b144c3864241a39c543eaa36111ad6 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed/info/34b144c3864241a39c543eaa36111ad6 2023-09-24 03:01:20,247 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/.tmp/info/1f096bd959d240eb9ba693da05a8cecb 2023-09-24 03:01:20,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed/info/34b144c3864241a39c543eaa36111ad6, entries=2, sequenceid=6, filesize=4.8 K 2023-09-24 03:01:20,248 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:01:20,248 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:01:20,248 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 03:01:20,248 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38603,1695524343980 2023-09-24 03:01:20,248 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 03:01:20,248 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 03:01:20,248 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 03:01:20,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1a79167d2d70acb808658c34229d25ed in 53ms, sequenceid=6, compaction requested=false 2023-09-24 03:01:20,250 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38603,1695524343980] 2023-09-24 03:01:20,251 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38603,1695524343980; numProcessing=1 2023-09-24 03:01:20,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b34ea2205ca045fe93d233d9d22ad681 2023-09-24 03:01:20,252 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38603,1695524343980 already deleted, retry=false 2023-09-24 03:01:20,252 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38603,1695524343980 expired; onlineServers=2 2023-09-24 03:01:20,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193/.tmp/l/b34ea2205ca045fe93d233d9d22ad681 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193/l/b34ea2205ca045fe93d233d9d22ad681 2023-09-24 03:01:20,253 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f096bd959d240eb9ba693da05a8cecb 2023-09-24 03:01:20,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b34ea2205ca045fe93d233d9d22ad681 2023-09-24 03:01:20,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193/l/b34ea2205ca045fe93d233d9d22ad681, entries=7, sequenceid=18, filesize=5.2 K 2023-09-24 03:01:20,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 11b6caa21568f4c9b7647ba9b24ca193 in 63ms, sequenceid=18, compaction requested=false 2023-09-24 03:01:20,267 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 03:01:20,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/namespace/1a79167d2d70acb808658c34229d25ed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 03:01:20,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:01:20,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/acl/11b6caa21568f4c9b7647ba9b24ca193/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-24 03:01:20,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 03:01:20,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1a79167d2d70acb808658c34229d25ed: 2023-09-24 03:01:20,270 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 03:01:20,270 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 03:01:20,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695524345995.1a79167d2d70acb808658c34229d25ed. 2023-09-24 03:01:20,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:01:20,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 03:01:20,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 11b6caa21568f4c9b7647ba9b24ca193: 2023-09-24 03:01:20,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695524346743.11b6caa21568f4c9b7647ba9b24ca193. 2023-09-24 03:01:20,276 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/.tmp/rep_barrier/6a85ef8ede0147dab17121e2fee2304c 2023-09-24 03:01:20,280 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a85ef8ede0147dab17121e2fee2304c 2023-09-24 03:01:20,291 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/.tmp/table/469634877dd94f4aa970b8e63285b527 2023-09-24 03:01:20,294 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 469634877dd94f4aa970b8e63285b527 2023-09-24 03:01:20,295 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/.tmp/info/1f096bd959d240eb9ba693da05a8cecb as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/info/1f096bd959d240eb9ba693da05a8cecb 2023-09-24 03:01:20,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f096bd959d240eb9ba693da05a8cecb 2023-09-24 03:01:20,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/info/1f096bd959d240eb9ba693da05a8cecb, entries=48, sequenceid=131, filesize=10.3 K 2023-09-24 03:01:20,300 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/.tmp/rep_barrier/6a85ef8ede0147dab17121e2fee2304c as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/rep_barrier/6a85ef8ede0147dab17121e2fee2304c 2023-09-24 03:01:20,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a85ef8ede0147dab17121e2fee2304c 2023-09-24 03:01:20,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/rep_barrier/6a85ef8ede0147dab17121e2fee2304c, entries=13, sequenceid=131, filesize=6.4 K 2023-09-24 03:01:20,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/.tmp/table/469634877dd94f4aa970b8e63285b527 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/table/469634877dd94f4aa970b8e63285b527 2023-09-24 03:01:20,310 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 469634877dd94f4aa970b8e63285b527 2023-09-24 03:01:20,310 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/table/469634877dd94f4aa970b8e63285b527, entries=24, sequenceid=131, filesize=6.9 K 2023-09-24 03:01:20,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 112ms, sequenceid=131, compaction requested=false 2023-09-24 03:01:20,324 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-24 03:01:20,324 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 03:01:20,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-24 03:01:20,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-24 03:01:20,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-24 03:01:20,326 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-24 03:01:20,349 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 03:01:20,349 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38603-0x100c7631a060001, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 03:01:20,349 INFO [RS:0;jenkins-hbase20:38603] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38603,1695524343980; zookeeper connection closed. 2023-09-24 03:01:20,350 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@235bdec] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@235bdec 2023-09-24 03:01:20,399 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,37585,1695524344064; all regions closed. 2023-09-24 03:01:20,399 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,35519,1695524344025; all regions closed. 2023-09-24 03:01:20,407 DEBUG [RS:2;jenkins-hbase20:37585] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/oldWALs 2023-09-24 03:01:20,407 INFO [RS:2;jenkins-hbase20:37585] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37585%2C1695524344064.meta:.meta(num 1695524345733) 2023-09-24 03:01:20,411 DEBUG [RS:1;jenkins-hbase20:35519] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/oldWALs 2023-09-24 03:01:20,411 INFO [RS:1;jenkins-hbase20:35519] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35519%2C1695524344025:(num 1695524345594) 2023-09-24 03:01:20,411 DEBUG [RS:1;jenkins-hbase20:35519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,411 INFO [RS:1;jenkins-hbase20:35519] regionserver.LeaseManager(133): Closed leases 2023-09-24 03:01:20,411 INFO [RS:1;jenkins-hbase20:35519] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-24 03:01:20,412 INFO [RS:1;jenkins-hbase20:35519] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 03:01:20,412 INFO [RS:1;jenkins-hbase20:35519] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 03:01:20,412 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 03:01:20,412 INFO [RS:1;jenkins-hbase20:35519] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 03:01:20,413 INFO [RS:1;jenkins-hbase20:35519] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35519 2023-09-24 03:01:20,413 DEBUG [RS:2;jenkins-hbase20:37585] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/oldWALs 2023-09-24 03:01:20,414 INFO [RS:2;jenkins-hbase20:37585] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37585%2C1695524344064:(num 1695524345594) 2023-09-24 03:01:20,414 DEBUG [RS:2;jenkins-hbase20:37585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,414 INFO [RS:2;jenkins-hbase20:37585] regionserver.LeaseManager(133): Closed leases 2023-09-24 03:01:20,414 INFO [RS:2;jenkins-hbase20:37585] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-24 03:01:20,414 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:01:20,414 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 03:01:20,414 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35519,1695524344025 2023-09-24 03:01:20,414 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 03:01:20,415 INFO [RS:2;jenkins-hbase20:37585] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37585 2023-09-24 03:01:20,415 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,35519,1695524344025] 2023-09-24 03:01:20,415 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35519,1695524344025; numProcessing=2 2023-09-24 03:01:20,416 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 03:01:20,416 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37585,1695524344064 2023-09-24 03:01:20,416 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,35519,1695524344025 already deleted, retry=false 2023-09-24 03:01:20,416 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,35519,1695524344025 expired; onlineServers=1 2023-09-24 03:01:20,416 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,37585,1695524344064] 2023-09-24 03:01:20,416 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,37585,1695524344064; numProcessing=3 2023-09-24 03:01:20,417 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,37585,1695524344064 already deleted, retry=false 2023-09-24 03:01:20,417 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,37585,1695524344064 expired; onlineServers=0 2023-09-24 03:01:20,417 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,34295,1695524342827' ***** 2023-09-24 03:01:20,417 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-24 03:01:20,417 DEBUG [M:0;jenkins-hbase20:34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c8d5c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-24 03:01:20,417 INFO [M:0;jenkins-hbase20:34295] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,34295,1695524342827 2023-09-24 03:01:20,417 INFO [M:0;jenkins-hbase20:34295] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,34295,1695524342827; all regions closed. 2023-09-24 03:01:20,417 DEBUG [M:0;jenkins-hbase20:34295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 03:01:20,417 DEBUG [M:0;jenkins-hbase20:34295] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-24 03:01:20,417 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-24 03:01:20,418 DEBUG [M:0;jenkins-hbase20:34295] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-24 03:01:20,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695524345238] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695524345238,5,FailOnTimeoutGroup] 2023-09-24 03:01:20,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695524345237] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695524345237,5,FailOnTimeoutGroup] 2023-09-24 03:01:20,418 INFO [M:0;jenkins-hbase20:34295] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-24 03:01:20,418 INFO [M:0;jenkins-hbase20:34295] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-24 03:01:20,418 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-24 03:01:20,418 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 03:01:20,418 INFO [M:0;jenkins-hbase20:34295] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-09-24 03:01:20,418 DEBUG [M:0;jenkins-hbase20:34295] master.HMaster(1512): Stopping service threads 2023-09-24 03:01:20,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 03:01:20,418 INFO [M:0;jenkins-hbase20:34295] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-24 03:01:20,418 ERROR [M:0;jenkins-hbase20:34295] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-24 03:01:20,419 INFO [M:0;jenkins-hbase20:34295] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-24 03:01:20,419 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-24 03:01:20,419 DEBUG [M:0;jenkins-hbase20:34295] zookeeper.ZKUtil(398): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-24 03:01:20,419 WARN [M:0;jenkins-hbase20:34295] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-24 03:01:20,419 INFO [M:0;jenkins-hbase20:34295] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-24 03:01:20,419 INFO [M:0;jenkins-hbase20:34295] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-24 03:01:20,420 DEBUG [M:0;jenkins-hbase20:34295] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-24 03:01:20,420 INFO [M:0;jenkins-hbase20:34295] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 03:01:20,420 DEBUG [M:0;jenkins-hbase20:34295] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 03:01:20,420 DEBUG [M:0;jenkins-hbase20:34295] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-24 03:01:20,420 DEBUG [M:0;jenkins-hbase20:34295] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 03:01:20,420 INFO [M:0;jenkins-hbase20:34295] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.29 KB heapSize=452.50 KB 2023-09-24 03:01:20,433 INFO [M:0;jenkins-hbase20:34295] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.29 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/37cdd1695cf549b2bc6cb9e63a71a187 2023-09-24 03:01:20,438 INFO [M:0;jenkins-hbase20:34295] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37cdd1695cf549b2bc6cb9e63a71a187 2023-09-24 03:01:20,439 DEBUG [M:0;jenkins-hbase20:34295] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/37cdd1695cf549b2bc6cb9e63a71a187 as hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/37cdd1695cf549b2bc6cb9e63a71a187 2023-09-24 03:01:20,443 INFO [M:0;jenkins-hbase20:34295] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37cdd1695cf549b2bc6cb9e63a71a187 2023-09-24 03:01:20,443 INFO [M:0;jenkins-hbase20:34295] regionserver.HStore(1080): Added hdfs://localhost:42749/user/jenkins/test-data/01d0daf2-31b1-93a5-c80a-2f4c48c41b6f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/37cdd1695cf549b2bc6cb9e63a71a187, entries=119, sequenceid=899, filesize=28.7 K 2023-09-24 03:01:20,444 INFO [M:0;jenkins-hbase20:34295] regionserver.HRegion(2948): Finished flush of dataSize ~376.29 KB/385323, heapSize ~452.48 KB/463344, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-09-24 03:01:20,446 INFO [M:0;jenkins-hbase20:34295] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 03:01:20,446 DEBUG [M:0;jenkins-hbase20:34295] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 03:01:20,449 INFO [M:0;jenkins-hbase20:34295] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-24 03:01:20,450 INFO [M:0;jenkins-hbase20:34295] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34295 2023-09-24 03:01:20,450 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 03:01:20,451 DEBUG [M:0;jenkins-hbase20:34295] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,34295,1695524342827 already deleted, retry=false 2023-09-24 03:01:20,516 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 03:01:20,516 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:35519-0x100c7631a060002, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 03:01:20,516 INFO [RS:1;jenkins-hbase20:35519] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,35519,1695524344025; zookeeper connection closed. 2023-09-24 03:01:20,516 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5bdad541] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5bdad541 2023-09-24 03:01:20,616 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 03:01:20,616 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:34295-0x100c7631a060000, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 03:01:20,616 INFO [M:0;jenkins-hbase20:34295] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,34295,1695524342827; zookeeper connection closed. 2023-09-24 03:01:20,716 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 03:01:20,716 INFO [RS:2;jenkins-hbase20:37585] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,37585,1695524344064; zookeeper connection closed. 2023-09-24 03:01:20,717 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:37585-0x100c7631a060003, quorum=127.0.0.1:50111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 03:01:20,717 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1a6ee5be] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1a6ee5be 2023-09-24 03:01:20,717 INFO [Listener at jenkins-hbase20.apache.org/38347] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-24 03:01:20,718 WARN [Listener at jenkins-hbase20.apache.org/38347] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 03:01:20,816 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 03:01:20,924 WARN [BP-1774531837-148.251.75.209-1695524339546 heartbeating to localhost/127.0.0.1:42749] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 03:01:20,924 WARN [BP-1774531837-148.251.75.209-1695524339546 heartbeating to localhost/127.0.0.1:42749] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1774531837-148.251.75.209-1695524339546 (Datanode Uuid a5e7cf8a-b768-4bf8-b378-6fa217b59d27) service to localhost/127.0.0.1:42749 2023-09-24 03:01:20,928 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data5/current/BP-1774531837-148.251.75.209-1695524339546] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 03:01:20,928 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data6/current/BP-1774531837-148.251.75.209-1695524339546] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 03:01:20,929 WARN [Listener at jenkins-hbase20.apache.org/38347] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 03:01:20,964 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 03:01:21,072 WARN [BP-1774531837-148.251.75.209-1695524339546 heartbeating to localhost/127.0.0.1:42749] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 03:01:21,072 WARN [BP-1774531837-148.251.75.209-1695524339546 heartbeating to localhost/127.0.0.1:42749] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1774531837-148.251.75.209-1695524339546 (Datanode Uuid 588da7dd-d9f6-44fd-b745-bdc2b0602739) service to localhost/127.0.0.1:42749 2023-09-24 03:01:21,073 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data3/current/BP-1774531837-148.251.75.209-1695524339546] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 03:01:21,074 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data4/current/BP-1774531837-148.251.75.209-1695524339546] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 03:01:21,074 WARN [Listener at jenkins-hbase20.apache.org/38347] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 03:01:21,077 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 03:01:21,181 WARN [BP-1774531837-148.251.75.209-1695524339546 heartbeating to localhost/127.0.0.1:42749] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 03:01:21,182 WARN [BP-1774531837-148.251.75.209-1695524339546 heartbeating to localhost/127.0.0.1:42749] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1774531837-148.251.75.209-1695524339546 (Datanode Uuid f3ab2fa5-1c59-4491-a50e-572eefd37b34) service to localhost/127.0.0.1:42749 2023-09-24 03:01:21,183 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data1/current/BP-1774531837-148.251.75.209-1695524339546] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 03:01:21,183 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c0a500b5-790c-0a32-ffbf-537e032c992b/cluster_2ccdfd90-9fb6-a422-a0cb-cdba197fec29/dfs/data/data2/current/BP-1774531837-148.251.75.209-1695524339546] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 03:01:21,202 INFO [Listener at jenkins-hbase20.apache.org/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 03:01:21,330 INFO [Listener at jenkins-hbase20.apache.org/38347] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-24 03:01:21,408 INFO [Listener at jenkins-hbase20.apache.org/38347] hbase.HBaseTestingUtility(1293): Minicluster is down